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PREFACE 


This book provides a modern and self-contained introduction to digital signal processing (DSP) and is written 
with several audiences in mind. First and foremost, it is intended to serve as a textbook suitable for a one- 
semester junior or senior level undergraduate course. To this extent, it includes the relevant topics covered 
in a typical undergraduate curriculum and is supplemented by a vast number of worked examples, drill 
exercises and problems. It also attempts to provide a broader perspective by introducing useful applications 
and additional special topics in each chapter. These form the background for more advanced graduate courses 
in this area and also allow the book to be used as a source of basic reference for professionals across various 
disciplines interested in DSP. 

Scope 

The text stresses the fundamental principles and applications of digital signal processing. The relevant con¬ 
cepts are explained and illustrated by worked examples and applications are introduced where appropriate. 
Since many applications of DSP relate to the processing of analog signals, some familiarity with basic analog 
theory, at the level taught in a typical undergraduate signals and systems course, is assumed and expected. 
In order to make the book self-contained, the key concepts and results from analog theory that are relevant 
to a study of DSP are outlined and included in an appendix. The topics covered in this book may be grouped 
into the following broad areas: 

1. The first chapter starts with a brief overview. An introduction to discrete signals, their representation 
and their classification is provided in Chapter 2. 

2. Chapter 3 details the analysis of digital filters in the time-domain using the solution of difference 
equations or the process of convolution that also serves to link the time domain and the frequency 
domain. 

3. Chapter 4 covers the analysis in the transformed domain using the ^-transform that forms a powerful 
tool for studying discrete-time signals and systems. 

4. Chapter 5 describes the analysis of discrete signals and digital filters in the frequency domain using 
the discrete-time Fourier transform (DTFT) that arises as a special case of the ^-transform. 

5. Chapter 6 introduces the jargon, terminology and variety of digital filters and studies and compares 
the various methods of studying them. 

6. Chapter 7 discusses the digital processing of analog signals based on the concepts of sampling and 
quantization and the spectral representation of sampled signals. 

7. Chapter 8 and Chapter 9 describe the the design of FIR and HR filters for various applications using 
well established techniques. 

8. Chapter 10 provides an introduction to the spectral analysis of both analog and discrete signals based 
on numerical computation of the DFT and the FFT and its applications. 
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Preface 


One of the concerns often voiced about undergraduate textbooks is the level of mathematical detail. This 
book takes the approach that even though mathematical rigor need not be sacrificed, it does not have to get 
in the way of understanding and applying useful DSP concepts. To this extent, the book attempts to preserve 
a rational approach and include all the necessary mathematical details. However, whenever possible, the 
results are also described and then applied to problem solving on the basis of simple heuristic explanations. 

In each chapter, a short opening section outlines the objectives and topical coverage. Central concepts 
are highlighted in review panels, illustrated by worked examples and followed by drill exercises with answers. 
Many figures have been included to help the student grasp and visualize critical concepts. Results are 
tabulated and summarized for easy reference and access. End-of-chapter problems include a variety of drills 
and exercises. Application oriented problems require the use of computational resources such as Matlab. 
Since our primary intent is to present the principles of digital signal processing, not software, we have made 
no attempt to integrate Matlab into the text. This approach maintains the continuity and logical flow of 
the textual material. However, for those interested, a suite of MATLAB-based routines that may be used 
to illustrate the principles and concepts presented in the book are available on the author’s website. We 
hasten to add two disclaimers. First, the choice of Matlab is not to be construed as an endorsement of 
this product. Second, the routines are supplied in good faith and the author is not responsible for any 
consequences arising from their use! A solutions manual for instructors is available from the publisher. 
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Chapter 1 


OVERVIEW 


1.0 Introduction 

Few other technologies have revolutionized the world as profoundly as those based on digital signal processing. 
For example, the technology of recorded music was, until recently, completely analog from end to end, and 
the most important commercial source of recorded music used to be the LP (long-playing) record. The 
advent of the digital compact disc changed all that in the span of just a few short years and made the 
long-playing record practically obsolete, with the advent and proliferation of high speed, low cost computers 
and powerful, user-friendly software packages, digital signal processing (DSP) has truly come of age. This 
chapter provides an overview of the terminology of digital signal processing and of the connections between 
the various topics and concepts covered in the text. 


1.1 Signals 

Our world is full of signals, both natural and man-made. Examples are the variation in air pressure when we 
speak, the daily highs and lows in temperature, and the periodic electrical signals generated by the heart. 
Signals represent information. Often, signals may not convey the required information directly and may 
not be free from disturbances. It is in this context that signal processing forms the basis for enhancing, 
extracting, storing, or transmitting useful information. Electrical signals perhaps offer the widest scope for 
such manipulations. In fact, it is commonplace to convert signals to electrical form for processing. 

The signals we encounter in practice are often very difficult to characterize. So, we choose simple 
mathematical models to approximate their behavior. Such models also give us the ability to make predictions 
about future signal behaviour. Of course, an added advantage of using models is that they are much easier 
to generate and manipulate. What is more, we can gradually increase the complexity of our model to obtain 
better approximations, if needed. The simplest signal models are a constant variation, an exponential decay 
and a sinusoidal or periodic variation. Such signals form the building blocks from which we can develop 
representations for more complex forms. 

This book starts with a quick overview of discrete signals, how they arise and how they are modeled. 
We review some typical measures (such as power and energy) used to characterize discrete signals and the 
operations of interpolation and decimation which are often used to change the sampling rate of an already 
sampled signal. 
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Chapter 1 Overview 


1.2 Digital Filters 

The processing of discrete signals is accomplished by discrete-time systems, also called digital filters. In 
the time domain, such systems may be modeled by difference equations in much the same way that analog 
systems are modeled by differential equations. We concentrate on models of linear time-invariant (LTI) 
systems whose difference equations have constant coefficients. The processing of discrete signals by such 
systems can be achieved by resorting to the well known mathematical techniques. For input signals that can 
be described as a sum of simpler forms, linearity allows us to find the response as the sum of the response 
to each of the simpler forms. This is superposition. Many systems are actually nonlinear. The study of 
nonlinear systems often involves making simplifying assumptions, such as linearity. The system response can 
also be obtained using convolution, a method based on superposition: if the response of a system is known 
to a unit sample (or impulse) input, then it is also known to any arbitrary input which can be expressed as 
a sum of such impulses. 

Two important classes of digital filters are FIR (finite impulse response) filters whose impulse response 
(response to an impulse input) is a finite sequence (lasts only for finite time) and HR (infinite impulse 
response) filters whose response to an impulse input lasts forever. 

1.2.1 The z-Transform 

The ^-transform is a powerful method of analysis for discrete signals and systems. It is analogous to the 
Laplace transform used to study analog systems. The transfer function of an LTI system is a ratio of 
polynomials in the complex variable z. The roots of the numerator polynomial are called zeros and of the 
denominator polynomial are called poles. The pole-zero description of a transfer function is quite useful if 
we want a qualitative picture of the frequency response. For example, the frequency response goes to zero if 
z equals one of the zero locations and becomes unbounded if z equals one of the pole locations. 

1.2.2 The Frequency Domain 

It turns out that discrete sinusoids and harmonic signals differ from their analog cousins in some striking 
ways. A discrete sinusoid is not periodic for any choice of frequency. Yet it has a periodic spectrum. An 
important consequence of this result is that if the spectrum is periodic for a sampled sinusoid, it should also 
be periodic for a sampled combination of sinusoids. This concept forms the basis for the frequency domain 
description of discrete signals called the Discrete-Time Fourier Transform (DTFT). And since analog 
signals can be described as a combination of sinusoids (periodic ones by their Fourier series and others by 
their Fourier transform), their sampled combinations (and consequently any sampled signal) have a periodic 
spectrum in the frequency domain. The central period corresponds to the true spectrum of the analog signal 
if the sampling rate exceeds the Nyquist rate. 

1.2.3 Filter Concepts 

The term filter is often used to denote systems that process the input in a specified way. In this context, 
filtering describes a signal-processing operation that allows signal enhancement, noise reduction, or increased 
signal-to-noise ratio. Systems for the processing of discrete-time signals are also called digital filters. 
Depending on the requirements and application, the analysis of a digital filter may be carried out in the time 
domain, the ^-domain or the frequency domain. A common application of digital filters is to modify the 
frequency response in some specified way. An ideal lowpass filter passes frequencies up to a specified value 
and totally blocks all others. Its spectrum shows an abrupt transition from unity (perfect transmission) in 
the passband to zero (perfect suppression) in the stopband. An important consideration is that a symmetric 
impulse response sequence possesses linear phase (in its frequency response) which results only in a constant 
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delay with no amplitude distortion. An ideal lowpass filter possesses linear phase because its impulse response 
happens to be a symmetric sequence but unfortunately, it cannot be realized in practice. 

One way to approximate an ideal lowpass filter is by symmetric truncation of its impulse response (which 
ensures linear phase). Truncation is equivalent to multiplying (windowing) the impulse response by a finite 
duration sequence (window) of unit samples. The abrupt truncation imposed by such a window results in 
an overshoot and oscillation in the frequency response that persists no matter how large the truncation 
index. To eliminate overshoot and reduce the oscillations, we use tapered windows. The impulse response 
and frequency response of highpass, bandpass and bandstop filters may be related to those of a lowpass filter 
using frequency transformations based on the properties of the DTFT. 

Filters that possess constant gain but whose phase varies with frequencies are called allpass filters and 
may be used to modify the phase characteristics of a system. A filter whose gain is zero at a selected 
frequency is called a notch filter and may be used to remove the unwanted frequency from a signal. A filters 
whose gain is zero at multiples of a selected frequency is called a comb filter and may be used to remove an 
unwanted frequency and its harmonics from a signal. 


1.3 Signal Processing 

Two conceptual schemes for the processing of signals are illustrated in Figure 1.2. The digital processing 
of analog signals requires that we use an analog-to-digital converter (ADC) for sampling the analog signal 
prior to processing and a digital-to-analog converter (DAC) to convert the processed digital signal back to 
analog form. 


Analog signal processing Digital signal processing of analog signals 



Figure 1.1 Analog and digital signal processing 


1.3.1 Digital Processing of Analog Signals 

Many DSP applications involve the processing of digital signals obtained by sampling analog signals and 
the subsequent reconstruction of analog signals from their samples. For example, the music you hear from 
your compact disc (CD) player is due to changes in the air pressure caused by the vibration of the speaker 
diaphragm. It is an analog signal because the pressure variation is a continuous function of time. However, 
the information stored on the compact disk is in digital form. It must be processed and converted to analog 
form before you can hear the music. A record of the yearly increase in the world population describes time 
measured in increments of one (year) while the population increase is measured in increments of one (person). 
It is a digital signal with discrete values for both time and population. 

For digital signal processing we need digital signals. To process an analog signal by digital means, we 
must convert it to a digital signal in two steps. First, we must sample it, typically at uniform intervals 
t s (every 2 ms, for example). The discrete quantity nt s is related to the integer index n. Next, we must 
quantize the sample values (amplitudes) (by rounding to the nearest millivolt, for example). The central 
concept in the digital processing of analog signals is that the sampled signal must be a unique representation 
of the underlying analog signal. Even though sampling leads to a potential loss of information, all is not lost! 
Often, it turns out that if we choose the sampling interval wisely, the processing of an analog signal is entirely 
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equivalent to the processing of the corresponding digital signal; there is no loss of information! This is one of 
the wonders of the sampling theorem that makes digital signal processing such an attractive option. For a 
unique correspondence between an analog signal and the version reconstructed from its samples, the sampling 
rate S must exceed twice the highest signal frequency /o- The value S = 2 f 0 is called the Nyquist sampling 
rate. If the sampling rate is less than the Nyquist rate, a phenomenon known as aliasing manifests itself. 
Components of the analog signal at high frequencies appear at (alias to) lower frequencies in the sampled 
signal. This results in a sampled signal with a smaller highest frequency. Aliasing effects are impossible to 
undo once the samples are acquired. It is thus commonplace to band-limit the signal before sampling (using 
lowpass filters). 

Numerical processing using digital computers requires finite data with finite precision. We must limit 
signal amplitudes to a finite number of levels. This process, called quantization, produces nonlinear effects 
that can be described only in statistical terms. Quantization also leads to an irreversible loss of information 
and is typically considered only in the final stage in any design. 

A typical system for the digital processing of analog signals consists of the following: 

An analog lowpass pre-filter or anti-aliasing filter which limits the highest signal frequency to ensure 
freedom from aliasing. 

A sampler which operates above the Nyquist sampling rate. 

A quantizer which quantizes the sampled signal values to a finite number of levels. Currently, 16-bit 
quantizers are quite commonplace. 

An encoder which converts the quantized signal values to a string of binary bits or zeros and ones (words) 
whose length is determined by the number of quantization levels of the quantizer. 

The digital processing system itself (hardware or software) which processes the encoded digital signal (or 
bit stream) in a desired fashion. 

A decoder which converts the processed bit stream to a DT signal with quantized signal values. 

A reconstruction filter which reconstructs a staircase approximation of the discrete time signal. 

A lowpass analog anti-imaging filter which extracts the central period from the periodic spectrum, removes 
the unwanted replicas and results in a smoothed reconstructed signal. 

1.3.2 Filter Design 

The design of filters is typically based on a set of specifications in the frequency domain corresponding to 
the magnitude spectrum or filter gain. The design of HR filters typically starts with a lowpass prototype 
from which other forms may be readily developed using frequency transformations. 


1.3.3 The Design of HR Filters 

The design of HR filters starts with an analog lowpass prototype based on the given specifications. Classical 
analog filters include Butterworth (maximally flat passband), Chebyshev I (rippled passband), Chebyshev 
II (rippled stopband) and elliptic (rippled passband and stopband). The analog lowpass prototype is then 
converted to a lowpass digital filter using an appropriate mapping, and finally to the required form using 
an appropriate spectral transformation. Practical mappings are based on response-invariance or equivalence 
of ideal operations such as integration and their numerical counterparts. Not all of these avoid the effects 
of aliasing. The most commonly used mapping is based on the trapezoidal rule for numerical integration 
and is called the bilinear transformation. It compresses the entire infinite analog frequency range into a 
finite range and thus avoids aliasing at the expense of warping (distorting) the analog frequencies. We can 
compensate for this warping if we prewarp (stretch) the analog frequency specifications before designing 
the analog filter. 
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1.3.4 The Design of FIR filters 

FIR filters are inherently stable and can be designed with linear phase leading to no phase distortion but 
their realization often involves a large filter length to meet given requirements. Their design is typically 
based on selecting a symmetric (linear phase) impulse response sequence of the smallest length that meets 
design specifications and involves iterative techniques. Even though the spectrum of the truncated ideal 
filter is, in fact, the best approximation (in the mean square sense) compared to the spectrum of any other 
filter of the same length, it shows the undesirable oscillations and overshoot which can be eliminated by 
modifying (windowing) the impulse response sequence using tapered windows. The smallest length that 
meets specifications depends on the choice of window and is often estimated by empirical means. 


1.4 The DFT and FFT 

The periodicity of the DTFT is a consequence of the fundamental result that sampling a signal in one 
domain leads to periodicity in the other. Just as a periodic signal has a discrete spectrum, a discrete-time 
signal has a periodic spectrum. This duality also characterizes several other transforms. If the time signal 
is both discrete and periodic, its spectrum is also discrete and periodic and describes the discrete Fourier 
transform (DFT). The DFT is essentially the DTFT evaluated at a finite number of frequencies and is 
also periodic. The DFT can be used to approximate the spectrum of analog signals from their samples, 
provided the relations are understood in their proper context using the notion of implied periodicity. The 
Fast Fourier Transform (FFT) is a set of fast practical algorithms for computing the DFT. The DFT and 
FFT find extensive applications in fast convolution, signal interpolation, spectrum estimation, and transfer 
function estimation. 


1.5 Advantages of DSP 

In situations where signals are encountered in digital form, their processing is performed digitally. In other 
situations that relate to the processing of analog signals, DSP offers many advantages. 

Processing 

DSP offers a wide variety of processing techniques that can be implemented easily and efficiently. Some 
techniques (such as processing by linear phase filters) have no counterpart in the analog domain. 

Storage 

Digital data can be stored and later retrieved with no degradation or loss of information. Data recorded by 
analog devices is subject to the noise inherent in the recording media (such as tape) and degradation due to 
aging and environmental effects. 

Transmission 

Digital signals are more robust and offer much better noise immunity during transmission as compared to 
analog signals. 

Implementation 

A circuit for processing analog signals is typically designed for a specific application. It is sensitive to 
component tolerances, aging, and environmental effects (such as changes in the temperature and humidity) 
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and not easily reproducible. A digital filter, on the other hand, is extremely easy to implement and highly 
reproducible. It may be designed to perform a variety of tasks without replacing or modifying any hardware 
but simply by changing the filter coefficients on the fly. 

Cost 

With the proliferation of low-cost, high-speed digital computers, DSP offers effective alternatives for a wide 
variety of applications. High-frequency analog applications may still require analog signal processing but their 
number continues to shrink. As long as the criteria of the sampling theorem are satisfied and quantization 
is carried out to the desired precision (using the devices available), the digital processing of analog signals 
has become the method of choice unless compelling reasons dictate otherwise. 

In the early days of the digital revolution, DSP did suffer form disadvantages such as speed, cost, and 
quantization effects but these continue to pale into insignificance with advances in semiconductor technology 
and processing and computing power. 

1.5.1 Applications of DSP 

Digital signal processing finds applications in almost every conceivable field. Its impact on consumer electron¬ 
ics is evidenced by the proliferation of digital communication, digital audio, digital (high-definition) television 
and digital imaging (cameras). Its applications to biomedical signal processing include the enhancement and 
interpretation of tomographic images and analysis of ECG and EEG signals. Space applications include 
satellite navigation and guidance systems and analysis of satellite imagery obtained by various means. And, 
the list goes on and continues to grow. 
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DISCRETE SIGNALS 


2.0 Scope and Objectives 

This chapter begins with an overview of discrete signals. It starts with various ways of signal classification, 
shows how discrete signals can be manipulated by various operations, and quantifies the measures used to 
characterize such signals. It introduces the concept of sampling and describes the sampling theorem as the 
basis for sampling analog signals without loss of information. It concludes with an introduction to random 
signals. 


2.1 Discrete Signals 

Discrete signals (such as the annual population) may arise naturally or as a consequence of sampling con¬ 
tinuous signals (typically at a uniform sampling interval t s ). A sampled or discrete signal x[n] is just an 
ordered sequence of values corresponding to the integer index n that embodies the time history of the signal. 
It contains no direct information about the sampling interval t s , except through the index n of the sample 
locations. A discrete signal x[n\ is plotted as lines against the index n. When comparing analog signals with 
their sampled versions, we shall assume that the origin t. = 0 also corresponds to the sampling instant n = 0. 
We need information about t s only in a few situations such as plotting the signal explicitly against time t 
(at t = ntg) or approximating the area of the underlying analog signal from its samples (as t s £]x[n]). 

| REVIEW PANEL 2a] 

Notation for a Numeric Sequence x[n] 

JJ. 

A marker (fj.) indicates the origin n = 0. Example: x[n\ = { 1, 2, 4, 8,...}. 

Jf 

Ellipses (...) denote infinite extent on either side. Example: x[n] = {2, 4, 6, 8,...} 

A discrete signal x[?r] is called right-sided if it is zero for n < N (where N is finite), causal if it is zero 
for n < 0, left-sided if it is zero for n > N, and anti-causal if it is zero for n > 0. 

| REVIEW PANEL 2^] 

Discrete Signals Can Be Left-Sided, Right-Sided, Causal, or Anti-Causal 

Left-sided Right-sided Causal Anti-causal 

(zero for n>N ) (zero for n<N ) (zero for n< 0 ) (zero for n>0) 



N N 
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A discrete periodic signal repeats every N samples and is described by 

x[n] = x[n± kN], k = 0,1,2,3,... (2-1) 

The period N is the smallest number of samples that repeats. Unlike its analog counterpart, the period N of 
discrete signals is always an integer. The common period of a linear combination of periodic discrete signals 
is given by the least common multiple (LCM) of the individual periods. 


The Period of a Discrete Periodic 

The period N is always an integer. For 

REVIEW PANEL 2.3 

Signal Is the Number o 

■ combinations, N is the LC 

if Samples per Period 

!M of the individual periods. 

i, =; i 


DRILL PROBLEM 2.1 


4 


(a) Let x[n] = {..., 1, 2, 0, 0, 4, 1, 2, 0, 0, 4, 1, 2, 0, 0, 4, 1, 2, 0, 0, 4, ...}. What is its period? 

4 

(b) Let x[n\ = {..., 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, ...} and 

y[n] = 1 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, ...}. 

Let g[n\ — x [n] + y[n}. What is the period of g[n\! What are the sample values in one period of g[n]7 


Answers: (a) 5 (b) 6, {2, 4, 4, 3, 3, 5} 


2.1.1 Signal Measures 

Signal measures for discrete signals are often based on summations. Summation is the discrete-time equiv¬ 
alent of integration. The discrete sum So, the absolute sum S A , and the cumulative sum (running sum) 
sc[n] of a signal x[n] are defined by 

oo oo n 

S D = £ x[n] S A = ^2 I*Ml s c[n]= ^ x[k] (2.2) 

n =—oo n =—oo k =—oo 

Signals for which the absolute sum |x[n]| is finite are called absolutely summable. For nonperiodic signals, 
the signal energy E is a useful measure. It is defined as the sum of the squares of the signal values 

OO 

E= Y, l*M| 2 (2.3) 


The absolute value allows us to extend this relation to complex-valued signals. Measures for periodic signals 
are based on averages since their signal energy is infinite. The average value x av and signal power P of a 
periodic signal x [n] with period N are defined as the average sum per period and average energy per period, 
respectively: 

N -1 JV-1 

Xav= nYI ^M P = I^MI 2 (2.4) 

n—0 n—0 

Note that the index runs from n = 0ton = JV-l and includes all N samples in one period. Only for 
nonperiodic signals is it useful to use the limiting forms 


*£av 


lim 

M—>-oo 


l 

2 M + 1 


*M 


n——M 


p = 


lim 

M—too 


l 

2 M + 1 


I^MI 2 


n=—M 


(2.5) 
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Signals with finite energy are called energy signals (or square summable). Signals with finite power are called 
power signals. All periodic signals are power signals. 



REVIEW PANEL 2.4 


Energy and Power in Discrete Signals 


OO 



Energy: E = ^ x[n] 2 

Power (if periodic with period N ): P = — I^MI 2 

n =—oo 


n —0 


EXAMPLE 2.1 (Signal Energy and Power) 

(a) Find the energy in the signal x[n\ = 3(0.5)™, n > 0. 

This describes a one-sided decaying exponential. Its signal energy is 


E= *>] = E 13(0.5)™ | 2 = X] 9(0.25)™ = 


n —0 


n —0 


1 - 0.25 


= 12 J 


Note: 


OO 1 

' 1 — a 

n —0 


(b) Consider the periodic signal x[n\ = 6cos(27rn/4) whose period is TV = 4. 

4 

One period of this signal is xi[n] = {6, 0, —6, 0}. The average value and signal power of x[n] is 


= i E = 0 


p - E 


n —0 


n —0 


^36 + 36 ) 


= 18 W 


(c) Consider the periodic signal x[n] = 6e j27r ™/ 4 whose period is N = 4. 

4 

This signal is complex-valued, with |x[n]| = 6. One period of this signal is Xi[n] = {6, 6, 6, 6}. 
The signal power of x[n] is 

1 3 1 

P= -E \ X VA\ 2 = ^(36 + 36 + 36 + 36) = 36W 

n—0 


DRILL PROBLEM 2.2 | 

4 

(a) Let x[n] = { 1, 2, 0, 0, 4}. What is the energy in x[ny. 

4 

(b) Let x[n] = {..., 1, 2, 0, 0, 4, 1, 2, 0, 0, 4, 1, 2, 0, 0, 4, 1, 2, ...}. What is the power in x[n]? 

(c) Let x[n] = {..., 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, ...} and 

y[n] = {..., 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, ...}. 

Let g[n] = x[n] + y[n\. What is the power in x[n], y[n\ and g[n\l What is the average value of g[n] ? 

Answers: (a) 21 (b) 4.2 (c) 2.5, 3, 10, 3 
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2.2 Operations on Discrete Signals 


Common operations on discrete signals include element-wise addition and multiplication. Two other useful 
operations are shifting and folding (or time reversal). 

Time Shift: The signal y[n] = x[n — a] describes a delayed version of x[n] for a > 0. In other words, if x[n] 
starts at n = N, then its shifted version y[n] = x[n — a] starts at n = N + a. Thus, the signal y[n] = x[n — 2] 
is a delayed (shifted right by 2) version of x[n], and the signal g[n] = x[n + 2] is an advanced (shifted left 
by 2) version of x[n\. A useful consistency check for sketching shifted signals is based on the fact that if 
y[n] = x[n — a] , a sample of x[n] at the original index n gets relocated to the new index tin based on the 
operation n = tin — a. 


Folding: The signal y[n\ = x[—n] represents a folded version of x[n], a mirror image of the signal x[n] about 
the origin n = 0. The signal y[n] = x[—n — a\ may be obtained from x[n ] in one of two ways: 


(a) x[n] 

(b) x[n\ 


delay (shift right) by a —> x[n — a] 


fold 


x[—n — a}. 


fold 


x[—n\ —> advance (shift left) by a —> x\—n — a}. 


In either case, a sample of x[n ] at the original index n will be plotted at a new index n n given by 
n = —tin — a, and this can serve as a consistency check in sketches. 


REVIEW PANEL 2.5 

Time delay means x[n] => x[n — M], M > 0, and folding means x[n\ => x[—n\ 

You can generate x[—n — M] from x[n] in one of two ways: 

1. Shift right M units: a;[n] => x[n — M). Then fold: x[n — M] => x[—n — M], 

2. Fold: x[n] => x[—n}. Then shift left M units: x[— n] => x[—(n + M )] = x[—n — M). 

Check: Use n =>—riN—M to confirm new locations n n for the origin n = 0 and end points of x[n\. 


EXAMPLE 2.2 (Operations on Discrete Signals) 

JJ- 

Let x[n\ = {2, 3, 4, 5, 6, 7}. Find and sketch the following: 

y[n\ = x[n — 3], f[n] = x[n + 2], g[n] = x[—n\, h[n ] = x[—n + 1], s[n] = x[—n — 2] 

Here is how we obtain the various signals: 

Jf 

y[n) = x[n — 3] = {0, 2, 3, 4, 5, 6, 7} (shift x[n) right 3 units) 

4 

f[n] = x[n + 2] = {2, 3, 4, 5, 6, 7} (shift x[n} left 2 units) 

4 

g[n) = x[—n] = {7, 6, 5, 4, 3, 2} (fold x[n} about n = 0) 

4 

h[n] = x [—n + 1] = {7, 6, 5, 4, 3, 2} (fold x[n], then delay by 1) 

4 

s[n] = x[—n — 2] = {7, 6, 5, 4, 3, 2} (fold x[n\, then advance by 2) 

Refer to Figure E2.2 for the sketches. 
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Figure E2.2 The signals for Example 2.2 


DRILL PROBLEM 2.3 

Jf 

(a) Let x[n] = {l, 4, 2, 3}. Express g[n] = x[—n + 2] as a sequence and sketch. 

4 

(b) Let x[n] = {3, 1, 4}. Express y[n] = x[n + 2] and f[n\ = x[—n — 1] as sequences and sketch? 

Answers: (a) g[n] = {3, 2, 4, 1} (b) y[n\ = {3, 1, 4, 0} f[n\ = {4, 1, 3}. 


2.2.1 Symmetry 

If a signal x[n\ is identical to its mirror image x[—n], it is called an even symmetric signal. If a;[n] 
differs from its mirror image x[—n] only in sign, it is called an odd symmetric or antisymmetric signal. 
Mathematically, 

x e [n\ = x e [—n] x a [n] = -x 0 [-n] (2.6) 

In either case, the signal extends over symmetric limits —N < n < N. For an odd symmetric signal, note 
that x„ [0] = 0 and the sum of samples in x 0 [n] over symmetric limits (—a, a) equals zero: 

M 

J2 Xo[k}=0 (2.7) 

k=—M 


REVIEW PANEL 2.6 

Characteristics of Symmetric Signals 

111) 1 . 

To [n] 

11 . « 

1 } 

Even symmetry: 

rr- pi 

•r e [n] = [-/i] Odd symmetry: x„ [n\ = 

I 

~-~x 0 [-n] and x o [0] = 0 


2.2.2 Even and Odd Parts of Signals 

Even symmetry and odd symmetry are mutually exclusive. Consequently, if a signal x[n] is formed by 
summing an even symmetric signal x e [n\ and an odd symmetric signal x 0 [n], it will be devoid of either 
symmetry. Turning things around, any signal x[n] may be expressed as the sum of an even symmetric part 
x e [n\ and an odd symmetric part x 0 [n]: 


x[n] = x e [n ] + x 0 [n} 

To find x e [n] and x 0 [n] from x[n\, we fold x[n] and invoke symmetry to get 

a;[—n] = x e [—n] + x 0 [—n] = x e [n] — x 0 \n ] 


( 2 . 8 ) 


(2.9) 
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Adding and subtracting the two preceding equations, we obtain 

x e [n] = 0.5 x[n] + 0.5a;[—?z] x 0 [n] = 0.5a;[n] — 0.5x[—n] (2-10) 

This means that the even part x e [n] equals half the sum of the original and folded version and the odd part 
x 0 [n\ equals half the difference between the original and folded version. Naturally, if a signal x [n] has even 
symmetry, its odd part x 0 [n ] will equal zero, and if x[n] has odd symmetry, its even part x e [n\ will equal 
zero. 

| REVIEW PANEL 2?P\ 

Any Discrete Signal Is the Sum of an Even Symmetric and an Odd Symmetric Part 

x[n] ~ x e [n] + x 0 [n] where x e [n] = 0.5cc[n] + 0.5x[—n] and x 0 [n] = 0.5x[n] — 0.5x|— n] 

How to implement: Graphically, if possible. How to check: Does x e [n] + x a [n] give x[n\? 


EXAMPLE 2.3 (Signal Symmetry) 

(a) Let x[n] = {4, —2, 4, —6}. Find and sketch its odd and even parts. 

4 

We zero-pad the signal to x[n■] = {4, —2, 4, —6, 0} so that it covers symmetric limits. Then 
0.5a:[n] = {2, -1, 2, -3, 0} 0.5x[-n] = {0, -3, 2, -1, 2} 

Zero-padding, though not essential, allows us to perform element-wise addition or subtraction with 
ease to obtain 

x e [n ] = 0.5cc[n] + 0.5x[— n\ = {2, —4, 4, —4, 2} 
x 0 [n] = 0.5x[n] — 0.5 x[—n\ = {2, 2, 0, —2, —2} 

The various signals are sketched in Figure E2.3A. As a consistency check you should confirm that 
£ o [0] = 0, = 0, and that the sum x e [n] + x Q [n] recovers x[n\. 


4t 4 

x [ri] 

i 

0.5x [a] ! 

,0.5x1-/!] 4 

x eM 


,Xo [«] 



2 , 2 ' 
Ji \ 

2 . 

n 

1 'I 

2 L' i 


n 

- 2 1 


*1 

he ji 

^ T 

-41 

\L \ 

1 1-2 

-2 


| 1-6 

Figure E2.3A The signal x[n] and its odd and even parts for Example 2.3(a) 


(b) Let x[n] = u[n} — u[n — 5]. Find and sketch its odd and even parts. 

The signal x[n] and the genesis of its odd and even parts are shown in Figure E2.3B. Note the value 
of x e [n] at n = 0 in the sketch. 



Figure E2.3B The signal x[n] and its odd and even parts for Example 2.3(b) 
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2.3 Decimation and Interpolation 

The time scaling of discrete-time signals must be viewed with care. For discrete-time signals, time scaling is 
equivalent to decreasing or increasing the signal length. The problems that arise in time scaling are not in 
what happens but how it happens. 

2.3.1 Decimation 

Decimation refers to a process of reducing the signal length by discarding signal samples. Suppose x[n] 
corresponds to an analog signal x(f) sampled at intervals t s . The signal y[n\ = x[2n\ then corresponds to 
the compressed signal x(2t) sampled at t s and contains only alternate samples of x[n\ (corresponding to 
x[0], x[2], a; [ 4 ], ...). We can also obtain y[n] directly from x(t) (not its compressed version) if we sample it 
at intervals 2 t s (or at a sampling rate S = 1/2 t s ). This means a twofold reduction in the sampling rate. 
Decimation by a factor of N is equivalent to sampling x(t) at intervals Nt s and implies an N-fold reduction 
in the sampling rate. The decimated signal x[Nn] is generated from x[n\ by retaining every iVth sample 
corresponding to the indices k = Nn and discarding all others. 

2.3.2 Interpolation 

If x[n ] corresponds to x(t) sampled at intervals t s , then y[n] = x[n/2] corresponds to x(t) sampled at t s /2 
and has twice the length of x[n ] with one new sample between adjacent samples of x\n]. If an expression for 
x[n\ (or the underlying analog signal) were known, it would be no problem to determine these new sample 
values. If we are only given the sample values of x[n] (without its analytical form), the best we can do is 
interpolate between samples. For example, we may choose each new sample value as zero ( zero interpolation ), 
a constant equal to the previous sample value ( step interpolation), or the average of adjacent sample values 
( linear interpolation). Zero interpolation is referred to as up-sampling and plays an important role in 
practical interpolation schemes. Interpolation by a factor of N is equivalent to sampling x{t) at intervals 
t s /N and implies an N-fold increase in both the sampling rate and the signal length. 


Some Caveats 

It may appear that decimation (discarding signal samples) and interpolation (inserting signal samples) are 
inverse operations but this is not always the case. Consider the two sets of operations shown below: 

x[n] —> decimate by 2 —> a;[2n] —> interpolate by 2 —> x[n] 

x[n\ —> interpolate by 2 —> x[n/2] —> decimate by 2 —> x[n\ 

On the face of it, both sets of operations start with x[n] and appear to recover x[n], suggesting that interpo¬ 
lation and decimation are inverse operations. In fact, only the second sequence of operations (interpolation 

JI 

followed by decimation) recovers x[n ] exactly. To see why, let x[n ] = {l, 2, 6, 4, 8}. Using step interpolation, 
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for example, the two sequences of operations result in 


{1 2, 6 , 4, 8 } 
{1, 2, 6 , 4, 8 } 


decimate 
n —> 2 n 
interpolate 
n —> n /2 


r 4 „ interpolate 

{ 1 , 6 , 8 }- 

n —> n/2 


{1, 1, 2, 2, 6 , 6 , 4, 4, 8 , 8 } 


{ 1 , 1 , 6 , 6 , 8 , 8 } 

decimate 


2 n 


{ 1 , 2 , 6 , 4, 8 } 


We see that decimation is indeed the inverse of interpolation, but the converse is not necessarily true. 
After all, it is highly unlikely for any interpolation scheme to recover or predict the exact value of the 
samples that were discarded during decimation. In situations where both interpolation and decimation are 
to be performed in succession, it is therefore best to interpolate first. In practice, of course, interpolation or 
decimation should preserve the information content of the original signal, and this imposes constraints on 
the rate at which the original samples were acquired. 


2.3.3 Fractional Delays 


Fractional (typically half-sample) delays are sometimes required in practice and can be implemented using 
interpolation and decimation. If we require that interpolation be followed by decimation and integer shifts, 
the correct result is obtained by using interpolation followed by an integer shift and decimation. To generate 
the signal y[n] = x[n — = x[ Nn ^ M ] from x[w\, we use the following sequence of operations. 


interpolate by N 


delay by M 


decimate by N 


r Nn—M 1 
1 N 1 


= y[n] 


The idea is to ensure that each operation (interpolation, shift, and decimation) involves integers. 


| REVIEW PANEL 2.8 | 

Decimation by N, Interpolation by N, and Fractional Delay by M/N 

Decimation: Keep only every Nth sample (at n = kN). This leads to potential loss of information. 
Interpolation: Insert N —1 new values after each sample. The new sample values may equal 
zero (zero interpolation), or the previous value (step interpolation), or linearly interpolated values. 
Fractional Delay (y[n\ = x[n — ^]): Interpolate x[n] by N, then delay by M, then decimate by N. 


EXAMPLE 2.4 (Decimation and Interpolation) 

4 

(a) Let x[n] = {1, 2, 5, —1}. Generate x[2n] and various interpolated versions of x[n/ 3]. 

4 

To generate y[n] = x[2 n], we remove samples at the odd indices to obtain x[2n] = {2, — 1}. 

4 

The zero-interpolated signal is g[n] = x[|] = {1, 0, 0, 2, 0, 0, 5, 0, 0, —1, 0, 0}. 

4 

The step-interpolated signal is h[n] = a:[|] = {1, 1, 1, 2, 2, 2, 5, 5, 5, —1, —1, —1}. 

4 

The linearly interpolated signal is s[n] = a;[|] = {1, 3 , |, 2, 3, 4, 5, 3, 1, —1, ——|}. 
In linear interpolation, note that we interpolated the last two values toward zero. 
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4 

(b) Let x[n] = {3, 4, 5, 6}. Find g[n] = x[2 
In either case, we first find y[n\ = x[n — 
g[n\ = y[2n] = x[2n - 1] = {4, 6}. 
h[n\ = ] = x[0.5n — 1] = {3, 3, 4, 4, 


n — 1] and the step-interpolated signal h\n] 
1 ] = {3, 4, 5, 6}. Then 

5, 5, 6, 6}. 


= x[0.5n — 1], 


(c) Let x[n] = {3, 4, 5, 6}. Find y[n] = x[2n/3] assuming step interpolation where needed. 

Since we require both interpolation and decimation, we first interpolate and then decimate to get 

JJ- 

After interpolation: g[n] = x[|] = {3, 3, 3, 4, 4, 4, 5, 5, 5, 6, 6, 6}. 

Jf 

After decimation: y[n) = g[2n] = x[|?r] = {3, 3, 4, 5, 5, 6}. 


(d) Let x[n] = {2, 4, 6, 8}. Find the signal y[n ] = x[n — 0.5] assuming linear interpolation where needed. 

We first interpolate by 2, then delay by 1, and then decimate by 2 to get 

b 

After interpolation: g[n] = x [= {2, 3, 4, 5, 6, 7, 8, 4} (last sample interpolated to zero). 

After delay: h[n] = g[n — 1] = = {2, 3, 4, 5, 6, 7, 8, 4}. 

4 

After decimation: y[n] = h[2n] = x) 2 ^ -1 ] = x[n — 0.5] = { 3, 5, 7, 4}. 


DRILL PROBLEM 2.5 

Jf 

Let x[n] = {8, 4, 2, 6}. Find y[n\ = x[2n], g[n] = x[2n + 1], h[n\ — x[0.5n], and f[n] = x[n + 0.5]. 
Assume linear interpolation where required. 

Answers: y[n] = {8, 2} g[n] = {4, 6} h[n\ = {8, 6, 4, 3, 2, 4, 6, 3} f[n] = {6, 3, 4, 3}. 


2.4 Common Discrete Signals 

The unit impulse (or unit sample) 6[n\, the unit step u[n ]. and the unit ramp are defined as 


S[n] 


0 , n yf 0 
1 , n = 0 


u[n ] 


0, n < 0 

1 , n > 0 


r[n] = nu[n\ 


0 , n < 0 
n, n > 0 


( 2 . 11 ) 


The discrete impulse is just a unit sample at n = 0. It is completely free of the kind of ambiguities associated 
with the analog impulse 5(t) at t = 0. The discrete unit step u[n] also has a well-defined, unique value of 
w[0] = 1 (unlike its analog counterpart u(t)). The signal x[n] = Anu[n] = Ar[n] describes a discrete ramp 
whose “slope” A is given by x[k] — x[k — 1], the difference between adjacent sample values. 
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REVIEW PANEL 2.9 


The Discrete Impulse, Step, and Ramp Are Well Defined at n = 0 


s [/?] 


u 1//1 


r |/zl 


1 

i 




4 

5 








n 




n 

m. 

n 


2.4.1 Properties of the Discrete Impulse 

The product of a signal x[n\ with the impulse 5{n — k] results in 

x[n]5[n — k] — x[k]S[n — k] (2.12) 

This is because S[n — k] is nonzero only at n = k where the value of x[n ] corresponds to x[k]. The result is 
an impulse with strength x[k]. The product property leads directly to 

OO 

a;[n]5[n — k] = x[k] (2.13) 

n—— oo 

This is the sifting property. The impulse extracts (sifts out) the value a:[fc] from x[n] at the impulse 
location n = k. 

2.4.2 Signal Representation by Impulses 

A discrete signal x[n\ may be expressed as a sum of shifted impulses S[n — k] whose sample values correspond 
to x[k], the values of x[n ] at n = k. Thus, 


x[n\ = x[k]5[n — k] 

k =—oo 

For example, the signals u[n) and r[n] may be expressed as a train of shifted impulses: 

OO OO 

u[n] = ^ 5[n — k] r[n\ = ^ kS[n — /c] 


(2.14) 


(2.15) 


fc=o 


fc=o 


The signal u[n] may also be expressed as the cumulative sum of <5[n], and the signal r[n] may be described 
as the cumulative sum of u\n\: 


u\n 


= r I n ] = “[*] 


(2.16) 


k=—c 


k =—c 


2.4.3 Discrete Pulse Signals 

The discrete rectangular pulse rect(n/2N ) and the discrete triangular pulse tri(n/A) are defined by 


/'M = f !, \n\ < N 

\2NJ \ 0 , elsewhere 



\n\ < N 
elsewhere 


(2.17) 
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The signal rect(^) has 2 N + 1 unit samples over —N < n < N. The factor 2 N in rect(T^) gets around 
the problem of having to deal with half-integer values of n when N is odd. The signal x[n\ = tri(n/iV) also 
has 2N + 1 samples over —N < n < N, with its end samples x[iV] and x\— iV] being zero. It is sometimes 
convient to express pulse-like signals in terms of these standard forms. 


| REVIEW PANEL 2.10 
The Discrete rect and tri Functions 


(N 

= 5)\ 

frect[«/2A?] (N = 5) \ 

tri [n/N] 



1 




l 








-till 

lilt. >' 


-N N -N N 


EXAMPLE 2.5 (Describing Sequences and Signals) 

(a) Let x[n] = (2) n and y[n] = S[n — 3]. Find z[n\ = x[n]y[n] and evaluate the sum A = z[n\. 

The product, z[n] = x[n]y[?r] = (2) 3 5[?r — 3] = 8<5[n — 3], is an impulse. 

The sum, A = J2 ~[ n ]> is given by J2 (2 ) n S[n — 3] = (2 ) 3 = 8 . 


(b) Mathematically describe the signals of Figure E2.5B in at least two different ways. 



x [/;] 

y [»] 

6 




6 

/? [ 72 ] 

2 

3 1 

1 | n 

4 

, 1 2 1 




4 

.'I 



4 

l 2 , 2' 

1 

-l 1 2 ' 

1 2 

4 5 

-3-2-1 



2 3 


Figure E2.5B The signals for Example 2.5(b) 


1. The signal x[n] may be described as the sequence x[n\ = {4, 2, —1, 3}. 

It may also be written as x[n ] = A5[n + 1] + 25[n] — (5[?z — 1] + 3(5[n — 2], 

2. The signal y[n\ may be represented variously as 
A numeric sequence: y[n] = {0, 0, 2, 4, 6 , 6 , 6 }. 

A sum of shifted impulses: y[n] = 26[n — 2] + A5[n — 3] + 6<5[n — 4] + 6<5[n — 5] + 6<5[n — 6]. 
A sum of steps and ramps: y[n] = 2 r[n — 1] — 2r[n — 4] — 6u[n — 7]. 

Note carefully that the argument of the step function is [n — 7] (and not [n — 6 ]). 

3. The signal h[n\ may be described as h[n] = 6tri(n/3) or variously as 

4 

A numeric sequence: h[n) = {0, 2, 4, 6 , 4, 2, 0}. 

A sum of impulses: h[n] = 2i5[n + 2] + 4<5[n + 1] + 6<5[n] + A5[n — 1] + 2 S[n — 2], 

A sum of steps and ramps: h[n] = 2 r[n + 3] — 4r[n] + 2 r[n — 3]. 
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DRILL PROBLEM 2.6 

(a) Sketch the signals x[n] = 5[n + 2] + 2<5[n — 1] and y[n } = 2 u[n + 1] — u[n — 3]. 

Jt 

(b) Express the signal h[n ] = {3, 3, 3, 5, 5, 5} using step functions. 

(c) Express the signal g[n ] = {2,4, 6,4,2} using tri functions. 

Answers: (b) h[n] = 3 u[n + 2] + 2 u[n — 1] — 5 u[n — 4] (c) g[n] = 6tri( z ^) 


2.4.4 The Discrete Sine Function 

The discrete sine function is defined by 

smc («) = (,»/«) ' smc(0) = 1 (2 - 18) 

The signal sine (n/N) equals zero at n = kN, k = ±1, ±2,.... At n = 0, sinc(0) = 0/0 and cannot be 
evaluated in the limit since n can take on only integer values. We therefore define sinc(0) = 1. The envelope 
of the sine function shows a mainlobe and gradually decaying sidelobes. The definition of sine {n/N) also 
implies that sinc(n) = S[n}. 

2.4.5 Discrete Exponentials 

Discrete exponentials are often described using a rational base. For example, the signal x[n\ = 2 n u[n\ shows 
exponential growth while y[n] = (0.5)"u[n] is a decaying exponential. The signal f[n\ = (—0.5)"it[rc] shows 
values that alternate in sign. The exponential x[n] = a n u[n], where a = re^ is complex, may be described 
using the various formulations of a complex number as 

x[n} = a n u[n] = (re jS )" u[?i] = r n e^ ne u[n] = r n [cos(n6) + j sin(n0)]u[n] (2-19) 

This complex-valued signal requires two separate plots (the real and imaginary parts, for example) for a 
graphical description. If 0 < r < 1, x[n] describes a signal whose real and imaginary parts are exponentially 
decaying cosines and sines. If r = 1, the real and imaginary parts are pure cosines and sines with a peak 
value of unity. If r > 1, we obtain exponentially growing sinusoids. 


2.5 Discrete-Time Harmonics and Sinusoids 

If we sample an analog sinusoid x{t) = cos(27t f 0 t) at intervals of t s corresponding to a sampling rate of 
S = l/t s samples/s (or S Hz), we obtain the sampled sinusoid 

x[n ] = cos(27t fnt a + 9) = cos(27t + 9) = cos(27t nF + 9) (2.20) 

The quantities / and u> = 2irf describe analog frequencies. The normalized frequency F = f /S is called the 
digital frequency and has units of cycles/sample. The frequency fl = 2irF is the digital radian frequency 
with units of radians/sample. The various analog and digital frequencies are compared in Figure 2.1. Note 
that the analog frequency f = S (orw = 2 ttS) corresponds to the digital frequency F = 1 (or O = 2i r). 
More generally, we find it useful to deal with complex valued signals of the form 

x[n] = e^ 2 ' nnF+ ^ = cos(27t nF + 9) + j sin(27r nF + 9) (2-21) 

This allows us to regard the real sinusoid = cos (27 xnF + 9) as the real part of the complex-valued signal 
x[n\. 
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Connection between analog and digital frequencies 
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Figure 2.1 Comparison of analog and digital frequencies 


REVIEW PANEL 2.11 


The Digital Frequency Is the Analog Frequency Normalized by Sampling Rate S 


F (cycles / sample) = 


/(cycles/sec) 

S^samples/sec) 


fl(radians/sample) = 


u> (radians/sec) 
S(samples/sec) 


= 2t tF 


2.5.1 Discrete-Time Harmonics Are Not Always Periodic in Time 

An analog sinusoid x(t) = cos(27t f 0 t + d) has two remarkable properties. It is unique for every frequency. 
And it is periodic in time for every choice of the frequency /o- Its sampled version, however, is a beast of a 
different kind. 

Are all discrete-time sinusoids and harmonics periodic in time? Not always! To understand this idea, 
suppose x[n ) is periodic with period N such that x[n] = x[n + N], This leads to 

cos(27rnFo + 9) = cos[27r(n + N)F 0 + 9] = cos(27rnFo + 0 + 2nNF 0 ) (2.22) 

The two sides are equal provided NFq equals an integer k. In other words, Fq must be a rational fraction 
(ratio of integers) of the form k/N. What we are really saying is that a DT sinusoid is not always periodic but 
only if its digital frequency is a ratio of integers or a rational fraction. The period N equals the denominator 
of k/N, provided common factors have been canceled from its numerator and denominator. The significance 
of k is that it takes k full periods of the analog sinusoid to yield one full period of the sampled sinusoid. 
The common period of a combination of periodic DT sinusoids equals the least common multiple (LCM) 
of their individual periods. If Fo is not a rational fraction, there is no periodicity, and the DT sinusoid is 
classified as nonperiodic or almost periodic. Examples of periodic and nonperiodic DT sinusoids appear in 
Figure 2.2. Even though a DT sinusoid may not always be periodic, it will always have a periodic envelope. 
This discussion also applies to complex-valued harmonics of the type e^ 27rnFo+0 K 


| REVIEW PANEL 2.12 | 

The Discrete Harmonic cos(27rnFb + &) or e-h 2 ’ mFo+e ) Is Not Always Periodic in Time 

It is periodic only if its digital frequency F 0 = k/N can be expressed as a ratio of integers. 

Its period equals N if common factors have been canceled in k/N. 

One period of the sampled sinusoid is obtained from k full periods of the analog sinusoid. 
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(a) cos(0.1257m) is periodic. Period N=16 



0 4 8 12 16 20 24 28 

DT Index n 


(b) cos(0.5h) is not periodic. Check peaks or zeros. 



0 4 8 12 16 20 24 28 

DT Index n 


Figure 2.2 Discrete-time sinusoids are not always periodic 


EXAMPLE 2.6 (Discrete-Time Harmonics and Periodicity) 

(a) Is x[n] = cos(2nFn) periodic if F = 0.32? If F = \/3? If periodic, what is its period TV? 

If F = 0.32, x[n] is periodic because F = 0.32 = = 35 = 77 • The period is TV = 25. 

If F = \/3, x[n] is not periodic because F is irrational and cannot be expressed as a ratio of integers. 


(b) What is the period of the harmonic signal x[n] = e> 0 2nn + e - ?°- 3n,r ? 

The digital frequencies in x[n] are Ei = 0.1 = ^ = ^- and F 2 = 0.15 = ^ = 
Their periods are TVi = 10 and TV 2 = 20. 

The common period is thus TV = LCM(TVi, TV 2 ) = LCM(10, 20) = 20. 


(c) The signal x(t) = 2 cos(407rf) + sin(607rT) is sampled at 75 Hz. What is the common period of the 
sampled signal x[n] , and how many full periods of x(t) does it take to obtain one period of x[n]l 

The frequencies in x(t) are /1 = 20 Hz and / 2 = 30 Hz. The digital frequencies of the individual 
components are F\ = ^ and F 2 = |g = | = jf-. Their periods are TVi = 15 and TV 2 = 5. 

The common period is thus TV = LCM(TVi, TV 2 ) = LCM(15,5) = 15. 

The fundamental frequency of x(t) is /o = GCD(20, 30) = 10 Hz. One period of x(t) is T = -jk = 0.1 s. 
Since TV = 15 corresponds to a duration of Nt s = ^ = 0.2 s, it takes two full periods of x(t) to obtain 
one period of x[n\. We also get the same result by computing GCD(fci, fc 2 ) = GCD(4, 2) = 2. 


DRILL PROBLEM 2.7 | 

(a) What is the digital frequency of x\n) = 2e^ 0 25n ' K+30 ■*? Is x\n\ periodic? 

(b) What is the digital frequency of y[n] = cos(0.5n + 30°)? Is y[n] periodic? 

(c) What is the common period TV of the signal f[n] = cos( 0 . 4 ?r 7 r) + sin( 0 . 5 n 7 r + 30°)? 
Answers: (a) Fq = 0.125, yes (b) Fq = 0.25/w, no (c) TV = 20 
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2.5.2 Discrete-Time Harmonics Are Always Periodic in Frequency 

Unlike analog sinusoids, discrete-time sinusoids and harmonics are always periodic in frequency. If we start 
with the sinusoid x[n\ = cos(27rnJ 7 o + 9) and add an integer m to Fq, we get 

cos[27m(.Fo + to) + 0] = cos(27rnFo + 9 + 27mm) = cos(27rnFo + 9) = x[n] 

This result says that discrete-time (DT) sinusoids at the frequencies F a ±m are identical. Put another way, 
a DT sinusoid is periodic in frequency (has a periodic spectrum) with unit period. The range —0.5 < F < 0.5 
defines the principal period or principal range. A DT sinusoid can be uniquely identified only if its 
frequency falls in the principal range. A DT sinusoid with a frequency Fq outside this range can always be 
expressed as a DT sinusoid with a frequency that falls in the principal period by subtracting out an integer 
M from F 0 such that the new frequency F a = F 0 — M satisfies —0.5 < F u < 0.5). The frequency F a is called 
the aliased digital frequency and it is always smaller than original frequency Fq. This discussion also applies 
to complex-valued harmonics of the type e^ 2 ' KnFo+e ' > . 

To summarize, a discrete-time sinusoid or harmonic is periodic in time only if its digital frequency Fq is 
a rational fraction, but it is always periodic in frequency (with unit period. 


| REVIEW PANEL 2.13 | 

The Discrete Harmonic cos(27rnJ 7 b + 9) or e i( 2 ' I ™ F o+0) Is Always Periodic in Frequency 

Its frequency period is unity (harmonics at Fq and Fq ± K are identical for integer K). 

It is unique only if F 0 lies in the principal period —0.5 < F 0 < 0.5. 

If Fq > 0.5, the unique frequency is F a = Fq—M, where the integer M is chosen to ensure —0.5 < F a < 0.5. 


DRILL PROBLEM 2.8 

(a) Let x[n} = eJ L4nlr = e j27rF “ n where F u is in the principal range. What is the value of F u ? 

(b) Let y [n] = cos( 2 . 4 n 7 r + 30°). Rewrite y[n\ in terms of its frequency in the principal range. 

(c) Rewrite f[n] = cos( 1 . 4 ?r 7 r + 20°) + cos( 2 . 4 ?r 7 r + 30°) using frequencies in the principal range. 

Answers: (a) —0.3 (b) cos( 0 . 4 n 7 r + 30°) (c) cos( 0 . 6 ?r 7 r — 20°) + cos( 0 . 4 ?r 7 r + 30°) 


2.6 The Sampling Theorem 

The central concept in the digital processing of analog signals is that the sampled signal must be a unique 
representation of the underlying analog signal. When the sinusoid x(t) = cos(27t f 0 t + 9) is sampled at the 
sampling rate S, the digital frequency of the sampled signal is Fq = fo/S. In order for the sampled sinusoid 
to permit a unique correspondence with the underlying analog sinusoid, the digital frequency Fq must lie in 
the principal range, i.e., |F 0 | < 0-5- This implies S > 2|/ 0 | and suggests that we must choose a sampling 
rate S that exceeds |2/ 0 |. More generally, the sampling theorem says that for a unique correspondence 
between an analog signal and the version reconstructed from its samples (using the same sampling rate), 
the sampling rate must exceed twice the highest signal frequency /max- The value S = 2/ max is called the 
critical sampling rate or Nyquist rate or Nyquist frequency. The time interval t s = — is called 

the Nyquist interval. For the sinusoid x{t) = cos(27r/of + 9), the Nyquist rate is Sn = 2/o = and this 
rate is equivalent to taking exactly two samples per period (because the sampling interval is t s = ^). In 
order to exceed the Nyquist rate, we should obtain more than two signal samples per period. 
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REVIEW PANEL 2.14 

The Sampling Theorem: How to Sample an Analog Signal Without Loss of Information 

For an analog signal band-limited to / max Hz, the sampling rate 5 must exceed 2/ max . 

5 = 2/ max defines the Nyquist rate. t s = , 2 j — defines the Nyquist interval. 

For an analog sinusoid: The Nyquist rate corresponds to taking two samples per period. 


DRILL PROBLEM 2.9 

(a) What is the critical sampling rate in Hz for the following signals: 

x(t) = cos(107rf) y{t ) = cos(107r<) + sin(157rf) f(t) = cos(107rf) sin(157rf) g{t) = cos 2 (107rf) 

(b) A 50 Hz sinusoid is sampled at twice the Nyquist rate. How many samples are obtained in 3 s? 

Answers: (a) 10, 15, 25, 20 (b) 600 


2.6.1 Signal Reconstruction and Aliasing 

Consider an analog signal x(t) = cos(2nf 0 t + 9) and its sampled version x[n\ = cos(27rn.Fo + Q), where 
Fq = fo/S. If x[n] is to be a unique representation of x(t), we must be able to reconstruct x(t) from x[n\. In 
practice, reconstruction uses only the central copy or image of the periodic spectrum of x[n] in the principal 
period —0.5 < F < 0.5, which corresponds to the analog frequency range — 0.55 < / < 0.55. We use a 
lowpass filter to remove all other replicas or images, and the output of the lowpass filter corresponds to the 
reconstructed analog signal. As a result, the highest frequency fn we can identify in the signal reconstructed 
from its samples is fn = 0.55. 

Whether the reconstructed analog signal matches x{t) or not depends on the sampling rate 5. If we 
exceed the Nyquist rate (i.e. 5 > 2/ 0 ), the digital frequency F 0 = fo/S is always in the principal range 
—0.5 < F < 0.5, and the reconstructed analog signal is identical to x(t). If the sampling rate is below the 
Nyquist rate (i.e. S < 2/ 0 ), the digital frequency exceeds 0.5. Its image in the principal range appears at 
the lower digital frequency F a = Fq — M (corresponding to the lower analog frequency f a — fo~ MS), where 
M is an integer that places the aliased digital frequency F a between —0.5 and 0.5 (or the aliased analog 
frequency f a between — 0.55 and 0.55'). The reconstructed aliased signal x a {t) = cos(27 rf a t + 9) is at a lower 
frequency f a = SF a than f 0 and is no longer a replica of x(t). The phenomenon, where a reconstructed 
sinusoid appears at a lower frequency than the original, is what aliasing is all about. The real problem 
is that the original signal x(t) and the aliased signal x a (t ) yield identical sampled representations at the 
sampling frequency 5 and prevent unique identification of the original signal x(t) from its samples! 


| REVIEW PANEL 2.15 | 

Aliasing Occurs if the Analog Signal cos(27r/ 0 t + 9) Is Sampled Below the Nyquist Rate 

If 5 < 2/o, the reconstructed analog signal is aliased to a lower frequency |/ a | < 0.55. We find f a as 
fa = fo~ MS, where M is an integer that places f a in the principal period (—0.55 < f a < 0.55). 

Before reconstruction, all frequencies must be brought into the principal period. 

The highest frequency of the reconstructed signal cannot exceed half the reconstruction rate. 


EXAMPLE 2.7 (Aliasing and Its Effects) 

(a) A 100-Hz sinusoid x(t) is sampled at 240 Hz. Has aliasing occurred? How many full periods of x(t) 
are required to obtain one period of the sampled signal? 
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The sampling rate exceeds 200 Hz, so there is no aliasing. The digital frequency is F = ^ 
Thus, five periods of x(t) yield 12 samples (one period) of the sampled signal. 


(b) A 100-Hz sinusoid is sampled at rates of 240 Hz, 140 Hz, 90 Hz, and 35 Hz. In each case, has aliasing 
occurred, and if so, what is the aliased frequency? 

To avoid aliasing, the sampling rate must exceed 200 Hz. If S = 240 Hz, there is no aliasing, and 
the reconstructed signal (from its samples) appears at the original frequency of 100 Hz. For all other 
choices of S, the sampling rate is too low and leads to aliasing. The aliased signal shows up at a lower 
frequency. The aliased frequencies corresponding to each sampling rate S are found by subtracting out 
multiples of S from 100 Hz to place the result in the range —OAS 1 < / < 0.5<S. If the original signal 
has the form x(t) = cos(2007rf + 9), we obtain the following aliased frequencies and aliased signals: 

1. S = 140 Hz, f a = 100 - 140 = -40 Hz, x a (t) = cos(-80tt t + 9) = cos(80tt t - 9) 

2. S = 90 Hz, f a = 100 - 90 = 10 Hz, x a (t) = cos(20tt t + 9) 

3. S = 35 Hz, f a = 100 - 3(35) = -5 Hz, x a (t) = cos(-10tt t + 9) = cos(10tH - 9) 

We thus obtain a 40-Hz sinusoid (with reversed phase), a 10-Hz sinusoid, and a 5-Hz sinusoid (with 
reversed phase), respectively. Notice that negative aliased frequencies simply lead to a phase reversal 
and do not represent any new information. Finally, had we used a sampling rate exceeding the Nyquist 
rate of 200 Hz, we would have recovered the original 100-Hz signal every time. Yes, it pays to play by 
the rules of the sampling theorem! 


(c) Two analog sinusoids X\ (t) (shown light) and X 2 (t) (shown dark) lead to an identical sampled version as 
illustrated in Figure E2.7C. Has aliasing occurred? Identify the original and aliased signal. Identify the 
digital frequency of the sampled signal corresponding to each sinusoid. What is the analog frequency 
of each sinusoid if S = 50 Hz? Can you provide exact expressions for each sinusoid? 


Two analog signals and their sampled version 



Examine the interval (0, 0.1) s. The sampled signal shows five samples per period. This covers three 
full periods of x\ (t) and so Fi = |. This also covers two full periods of X 2 (t), and so F 2 = |. Clearly, 
x\ (t) (with | Fi| > 0.5) is the original signal that is aliased to X2 (t). The sampling interval is 0.02 s. 
So, the sampling rate is S = 50 Hz. The original and aliased frequencies are /1 = SFi = 30 Hz and 
f 2 = SF 2 = 20 Hz. 

From the figure, we can identify exact expressions for x\ ( t ) and X 2 (t) as follows. Since x\ (t) is a delayed 
cosine with aq(0) = 0.5, we have Xi(t) = cos(607rf — |). With S = 50 Hz, the frequency /1 = 30 Hz 
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actually aliases to f 2 = —20 Hz, and thus ^(t) = cos(—407rf — |) = cos(407rf + |). With F = = 0.6 

(or F = —0.4), the expression for the sampled signal is x[n] = cos(2nnF — |). 


(d) A 100-Hz sinusoid is sampled, and the reconstructed signal (from its samples) shows up at 10 Hz. 
What was the sampling rate 5? 

One choice is to set 100 — S' = 10 and obtain S = 90 Hz. Another possibility is to set 100 — S = —10 to 
give S = 110 Hz. In fact, we can also subtract out integer multiples of S from 100 Hz, set 100 — MS = 10 
and compute S for various choices of M. For example, if M = 2, we get S = 45 Hz and if M = 3, 
we get S = 30 Hz. We can also set 100 — NS = —10 and get S = 55 Hz for N = 2. Which of these 
sampling rates was actually used? We have no way of knowing! 


DRILL PROBLEM 2.10 | 

(a) A 60-Hz sinusoid x(t) is sampled at 200 Hz. What is the period N of the sampled signal? How many 
full periods of x(t) are required to obtain these N samples? What is the frequency (in Hz) of the analog 
signal reconstructed from the samples? 

(b) A 160-Hz sinusoid x(t) is sampled at 200 Hz. What is the period N of the sampled signal? How many 
full periods of x(t) are required to obtain these N samples? What is the frequency (in Hz) of the analog 
signal reconstructed from the samples? 

(c) The signal x(t) = cos(607rf + 30°) is sampled at 50 Hz. What is the expression for the analog signal 
y(t) reconstructed from the samples? 

(d) A 150-Hz sinusoid is to be sampled. Pick the range of sampling rates (in Hz) closest to 150 Hz that 

will cause aliasing but prevent phase reversal of the analog signal reconstructed from the samples. 
Answers: (a) 10, 3, —60 (b) 5, 4, 40 (c) y(t) = cos(407rf — 30°) (d) 100 < S < 150 


2.6.2 Reconstruction at Different Sampling Rates 

There are situations when we sample a signal using one sampling rate Si but reconstruct the analog signal 
from samples using a different sampling rate 62 . In such situations, a frequency fo in the original signal 
will result in a digital frequency Fo = fo/S%. If S± > 2/o, there is no aliasing, Fo is in the principal range 
and the recovered frequency is just f r = F 0 S 2 = fo(S 2 / S-\). If Sj < 2/ 0 , there is aliasing and the recovered 
frequency is f r = F a S 2 == f a (S 2 /Si), where F 0 corresponds to the aliased digital frequency in the principal 
range. In other words, all frequencies, aliased or recovered, should be identified by their principal period. 


REVIEW PANEL 2.16 

Aliased or Reconstructed Frequencies Are Always Identified From The Principal Period 

Sampling: Unique digital frequencies always lie in the principal period —0.5 < F a < 0.5. 
Reconstruction at Sr: Analog frequencies lie in the principal period —0.5 Sr < f a < 0 .5Sr. 

The reconstructed frequency is f r = SrF q = Sr 


EXAMPLE 2.8 (Signal Reconstruction at Different Sampling Rates) 

A 100-Hz sinusoid is sampled at S Hz, and the sampled signal is then reconstructed at 540 Hz. What is the 
frequency of the reconstructed signal if S = 270 Hz? If S = 70 Hz? 
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1. If S = 270 Hz, the digital frequency of the sampled signal is F = ^=§ = which lies in the principal 
period. The frequency f r of the reconstructed signal is then f r = SF = 540F = 200 Hz. 

2. If S = 70 Hz, the digital frequency of the sampled signal is F = ^ = -y. which does not lie in the 
principal period. The frequency of the principal period is .F = ^ — 1 = — |, and the frequency f r of 
reconstructed signal is then f r = 70 F = SF = —30 Hz. The negative sign simply translates to a phase 
reversal in the reconstructed signal. 


DRILL PROBLEM 2.11 

(a) A 60 Hz signal is sampled at 200 Hz. What is the frequency (in Hz) of the signal reconstructed from 
the samples if the reconstruction rate is 300 Hz? 

(b) A 160 Hz signal is sampled at 200 Hz. If the frequency of the signal reconstructed from the samples 
is also 160 Hz, what reconstruction rate (in Hz) was used? 

Answers: (a) 90 (b) 800 


2.7 An Introduction to Random Signals 

The signals we have studied so far are called deterministic or predictable. They are governed by a unique 
mathematical representation that, once established, allows us to completely characterize the signal for all 
time, past, present, or future. In contrast to this is the class of signals known as random or stochastic 
whose precise value cannot be predicted in advance. We stress that only the future values of a random signal 
pose a problem since past values of any signal, random or otherwise, are exactly known once they have 
occurred. Randomness or uncertainty about future signal values is inherent in many practical situations. In 
fact, a degree of uncertainty is essential for communicating information. The longer we observe a random 
signal, the more the additional information we gain and the less the uncertainty. To fully understand the 
nature of random signals requires the use of probability theory, random variables, and statistics. Even with 
such tools, the best we can do is to characterize random signals only on the average based on their past 
behavior. 

2.7.1 Probability 

Figure 2.3 shows the results of two experiments, each repeated under identical conditions. The first exper¬ 
iment always yields identical results no matter how many times it is run and yields a deterministic signal. 
We need to run the experiment only once to predict what the next, or any other run, will yield. 

The second experiment gives a different result or realization x[t) every time the experiment is repeated 
and describes a stochastic or random system. A random signal or random process X(t) comprises 
the family or ensemble of all such realizations obtained by repeating the experiment many times. Each 
realization x(t), once obtained, ceases to be random and can be subjected to the same operations as we use 
for deterministic signals (such as derivatives, integrals, and the like). The randomness of the signal stems 
from the fact that one realization provides no clue as to what the next, or any other, realization might yield. 
At a given instant t, each realization of a random signal can assume a different value, and the collection of 
all such values defines a random variable. Some values are more likely to occur, or more probable, than 
others. The concept of probability is tied to the idea of repeating an experiment a large number of times 
in order to estimate this probability. Thus, if the value 2 V occurs 600 times in 1000 runs, we say that the 
probability of occurrence of 2 V is 0.6. 
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(a) Four realizations of a deterministic signal 



(b) Four realizations of a random signal 



Figure 2.3 Realizations of a deterministic and stochastic process 


The probability of an event A , denoted Pr(A), is the proportion of successful outcomes to the (very 
large) number of times the experiment is run and is a fraction between 0 and 1 since the number of successful 
runs cannot exceed the total number of runs. The larger the probability Pr(A), the more the chance of event 
A occurring. To fully characterize a random variable, we must answer two questions: 

1. What is the range of all possible (nonrandom) values it can acquire? This defines an ensemble space, 
which may be finite or infinite. 

2. What are the probabilities for all the possible values in this range? This defines the probability 
distribution function F(x). Clearly, F(x) must always lie between 0 and 1. 

It is common to work with the derivative of the probability distribution function called the probability 
density function f(x). The distribution function F(x) is simply the running integral of the density f(x): 

f( x ) = or F ( x ) = j fW dX (2-23) 

The probability F(x\) = Pr[X < X\] that X is less than X\ is given by 

/ Xl 

f(x) dx (2.24) 

-OO 

The probability that X lies between X\ and x-i is Pr[xi < X < x 2 ] = F(x 2 ) — F(x 1 ). The area of f(x) is 1. 


2.7.2 Measures for Random Variables 


Measures or features of a random variable X are based on its distribution. The mean, or expectation, is a 
measure of where the distribution is centered and is defined by 


E{x) = m x = / xf(x) dx (mean or expectation) 

J —OO 

The mean square value is similarly defined by 

POO 

E(x 2 ) = / x 2 f{x) dx (mean square value) 


(2.25) 


(2.26) 
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Many of the features of deterministic or random signals are based on moments. The nth moment m n is 
defined by 

/ OO 

x n f(x)dx (nth moment) (2.27) 

-OO 

We see that the zeroth moment gives the signal area, the first moment m i corresponds to the mean, 
and the second moment m 2 defines the mean square value. Moments about the mean are called central 
moments and also find widespread use. The nth central moment p n is defined by 


Mn — 



m x ) n f(x ) dx 


(nth central moment) 


(2.28) 


A very commonly used feature is the second central moment /i 2 - It is also called the variance, denoted cr 2 , 
and defined by 


= E[(x — m x ) 2 } = /i 2 = / (x — m x ) 2 f(x) dx (variance) 


(2.29) 


The variance may be expressed in terms of the mean and the mean square values as 


= E[{x - m x ) 2 ] = E{x 2 ) ~m 2 x = x 2 f{x) dx - m 2 x 


(2.30) 


The variance measures the spread (or dispersion) of the distribution about its mean. The less the spread, 
the smaller is the variance. The quantity a is known as the standard deviation and provides a measure 
of the uncertainty in a physical measurement. The variance is also a measure of the ac power in a signal. 
For a periodic deterministic signal x(t) with period T, the variance can be readily found by evaluating the 
signal power (and subtracting the power due to the dc component if present) 


o-2 = 


T 


2 {t)dt — 


1 2 


T 


c(t) dt 


total signal power 


dc power 


(2.31) 


This equation can be used to obtain the results listed in the following review panel. 


REVIEW PANEL 2.17 

The Variance of Some Useful Periodic Signals With Period T 
Sinusoid: If x(t) = Acos(2-7r|d + 9 ), then cr 2 = A-. 

Triangular Wave: If x(t) = A|t, 0 < t < T, or x(t) = A( 1 — j|^), |t| < 0.5T, then cr 2 = 
Square Wave: If x(t) = A, 0 < t < 0.5 T and x(t) = 0, 0.5 <t <T, then a 2 = 


DRILL PROBLEM 2.12 

(a) Find the variance of the periodic signal x(t) = A, 0 < t < 0.25 T and x(t) = 0, 0.25T <t <T. 

(b) Find the variance of the raised cosine signal x(t) = A[ 1 + cos(27r^ + 0)]. 

Answers: (a) A A 2 (b) |A 2 
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The distribution function F(x) is given by 

{ 0 x < a 

a < x < b (uniform distribution function) (2.35) 

1 x > b 

This is a finite ramp that rises from a value of zero at x = a to a value of unity at x = (3 and equals unity 
for x > a. For a uniform distribution in which values are equally likely to fall between —0.5 and 0.5, the 
density function is f(x) = 1, —0.5 < x < 0.5 with a mean of zero and a variance of yrj. 

Uniform distributions occur frequently in practice. When quantizing signals in uniform steps, the error 
in representing a signal value is assumed to be uniformly distributed between —0.5A and 0.5A, where A is 
the quantization step. The density function of the phase of a sinusoid with random phase is also uniformly 
distributed between —n and tt. 


DRILL PROBLEM 2.13 


(a) If the quantization eri 
the density function /(e) a 

(b) The phase of a sinusoi 
variance. 

1/A 

'or e is assumed to be uniformly distributed between —0.5A and 0.5A, sketch 
ind compute the variance. 

d with random phase is uniformly distributed between — tt and tt. Compute the 

/(e) 

Answers: (a) 



<7 = 7 (b) V 

8 

-A/2 A/2 ' 


2.7.6 The Gaussian or Normal Distribution 


The Gaussian or normal probability density is bell shaped and defined by 


f(x) = 


1 


72 


exp 


Trot. 


(x - m x y 


2(7? 


(normal distribution) 


(2.36) 


It has a mean of m x and a variance of a x . This density function has a single peak at x = m Xl even symmetry 
about the peak (x = m x ) and inflection points at m x ± a. 

The Gaussian process exhibits several useful properties 

1. The variable ax + b where a > 0 is also normally distributed. 

2. The sum of normally distributed random signals is also normally distributed. The mean of the sum 
equals the sum of the individual means and, if the statistically independent, the variance of the sum equals 
the sum of the individual variances. 

3. The ratio of the mean deviation (x — m x ) and the standard deviation cr x for all normal distributions 
equals \/2/tt. Thus, for normal distributions, one may equally well work with the mean deviation rather 
than the standard deviation. 

4. All the higher order moments of a Gaussian random variable may be obtained from a knowledge of the 
first two moments alone. In particular, the n th central moments are zero for odd values of n and the following 
relation then obtains for the even order (n = 2k) central moments 


E[(x - m x ) 2k ] = (1)(3)(5)... (2k 1 )a 2k = g, n = 2fc 


(central moments of Gaussian) (2.37) 
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The Gaussian Distribution Function 


The distribution function F{x) of a Gaussian distribution cannot be written in closed form and is given by 


F{x) = 


f2na 2 J -c 


exp - 


{x - m x )‘ 


dx (Gaussian distribution function) 


The Standard Gaussian Distribution 

A Gaussian distribution with a mean of zero and a variance of unity ( m x = 0, a 2 = 1) is called a standard 
Gaussian and denoted P{x). 

1 f X 2 

P(x) = _ / e~ x / 2 dx (standard Gaussian distribution) (2.39) 

V 27T J — oo 


The Error Function 

Another function that is used extensively is the error function defined by 


2 f x 2 

erf(x) = —j= / e~ x dx (error function) 
v 71 Jo 


The Gaussian distribution F(x) may be expressed in terms of the standard form or the error function as 


F(x) = P 


= 0.5+ 0.5 erf 


The probability that x lies between x\ and x 2 may be expressed in terms of the error function as 


Pr[xi < x < X 2 [ = F(x 2 ) — F(xi) = 0.5 erf 


X2 — m x 


— 0.5 erf 


x\ — m a 


This is a particularly useful form since tables of error functions are widely available. A note of caution to the 
unwary, however. Several different, though functionally equivalent, definitions of P{x), erf(x) and related 
functions are also prevalent in the literature. 


The Q-Function 

The Q-function describes the area of the tail of a Gaussian distribution. For the standard Gaussian, the 
area Q{x) of the tail is given by 

Q(x ) = 1 — P(x) = , _ / e~ x I 2 dx 

V2 nj x 

The Q-function and may also be expressed in terms of the error function as 

Q(x) = 0.5 - 0.5 erf(x/\/2) (2.43) 

The probability that x lies between X\ and X 2 may also be expressed in terms of the Q-function as 

Pr[xi < x < x 2 \ = Q ^ - Q ^ a ’ 2 —— (2.44) 

The results for the standard distribution may be carried over to a distribution with arbitrary mean m x and 
arbitrary standard deviation a x via the simple change of variable x —> (x — m x )/a. 
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The Central Limit Theorem 

The central limit theorem asserts that the probability density function of the sum of many random signals 
approaches a Gaussian as long as their means are finite and their variance is small compared to the total 
variance (but nonzero). The individual processes need not even be Gaussian. 


2.7.7 Discrete Probability Distributions 

The central limit theorem is even useful for discrete variables. When the variables that make up a given 
process s are discrete and the number n of such variables is large, that is, 


= ^ xi, n » 1 


we may approximate s by a Gaussian whose mean equals nm x and whose variance equals na x . Thus, 


fn(s) 


V 2nn(J x 


exp 


(s - nm x )' i 


, n » 1 


(2.45) 


Its distribution allows us to compute the probability Pr[si < s < S 2 ] in terms of the error function or 
Q-function as 


Pr[si < s < S 2 ] « 0.5 erf 


s 2 — nm a 


r\/2n 


— 0.5 erf 


Si — mn x 


ry/2n 


= Q 


si — nm a 
CTy/n 


-Q 


s 2 — nin x 
<J\fn 


(2.46) 


This relation forms the basis for numerical approximations involving discrete probabilities. 


The Binomial Distribution 

Consider an experiment with two outcomes which result in mutually independent and complementary events. 
If the probability of a success is p, and the probability of a failure is q = 1 — p, the probability of exactly k 
successes in n trials follows the binomial distribution and is given by 

Pr[s = k] = p n (k) = C£(p) k ( 1 — p) n ~ k (binomial probability) (2.47) 

Here, represents the binomial coefficient and may be expressed in terms of factorials or gamma 
functions as 

= n\ = r(n +1) 
k\ (n — k)\ T(k + 1) T(n — k + 1) 

The probability of at least k successes in n trials is given by 


n 

Pr[s > k] = y^p ra (f) = I p (k , n — k + 1) 
i=k 


where J s (a,5) is the incomplete beta function defined by 


I x {a,b) = 


B(a , b) 


t°-i(i -ty-'dt 


B(a , b) 


TaTb 

r(a + b) ’ 


a > 0, b > 0 
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The probability of getting between k\ and k 2 successes in n trials describes a cumulative probability 
because we must sum the probabilities of all possible outcomes for the event (the probability of exactly k-\, 
then k\ + 1 , then k\ + 2 successes, and so on to k 2 successes) and is given by 

ki 

Pr[fci < s < k 2 ]= ^ Pn{i) 

i=k 1 

For large n, its evaluation can become a computational nightmare. 

Some Useful Approximations 

When n is large and neither p —> 0 nor q —■> 0, the probability p n (k) of exactly k successes in n trials may 
be approximated by the Gaussian 

p n (k) = C£(p) k ( 1 - p) n ~ k ^ y=f ex P ~ ^ ’ m = UPl ^ = n ^ 1 “ 

This result is based on the central limit theorem and called the de Moivre-Laplace approximation. It 
assumes that a 2 1 and | k — m\ is of the same order as er or less. Using this result, the probability of at 
least k successes in n trials may be written in terms of the error function or Q-function as 

Pr[s > k] = 0.5 - 0.5erf (*-^\ = Q 

Similarly, the cumulative probability of between k\ and k 2 successes in n trials is 

* 1 * ^ ^»— (*5r) ^ (^) 

The Poisson probability 

If the number of trials n approaches infinity and the probability p of success in each trial approaches zero 
but their product m = np remains constant, the binomial probability is well approximated by 

Pr[s = jfe] = Cl(p) k { 1 - p) n ~ k w m = p m (k ) (Poisson probability) (2.48) 

where n^> l,p <C 1 and m = np. This is known as the Poisson probability. The mean and variance of this 
distribution are both equal to m. In practical situations, the Poisson approximation is often used whenever 
n is large and p is small and not just under the stringent limiting conditions imposed in its derivation. Unlike 
the binomial distribution which requires probabilities for both success and failure, the Poisson distribution 
requires only the probability of a success p (through the parameter m = np that describes the expected 
number of successes) and may thus be used even when the number of unsuccessful outcomes is unknown. 
The probability that the number of successes will lie between 0 and k inclusive, if the expected number is 
in, is given by the summation 

1c 1c 

^ ^ m l e~ rn 

Pr[s < k\ = ^ kp m (i) = --— = 1 — P{k + 1, m), k > 1 

»=0 t=o l - 

where P(a,x) is the so called incomplete gamma function defined by 

1 r x 

P(a,x ) = / t a ~ 1 e~ t dt a>0 

r («) Jo 
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Note that Pr[s < 0] = e m . For large m, the Poisson probability of exactly k successes may also be 
approximated using the central limit theorem to give 


Pm(k) 


1 

\j2itm 


exp 


(k — m ) 2 
2m 


Using this approximation, the probability of between ki and /c 2 successes is 


Pr[fci < s < fc 2 ] 


0.5 erf 


fc 2 — m 
V 7 2 to 


0.5 erf 




-Q 



2.7.8 Distributions for Deterministic Signals 

The idea of distributions also applies to deterministic periodic signals for which they can be found as exact 
analytical expressions. Consider the periodic signal x(t) of Figure 2.5. The probability Pr[A < 0] that 
x(t) < 0 is zero. The probability Pr[X < 3] that x(t) is less than 3 is 1. Since x(t) varies linearly over one 
period (T = 3), all values in this range are equally likely. This means that the density function is constant 
over the range 0 < x < 3 with an area of unity, and the distribution F(x) rises linearly from zero to unity 
over this range. The distribution F(x) and density f(x) are also shown in Figure 2.5. The variance can be 
computed either from the signal x(t) itself or from its density function f(x). The results are repeated for 
convenience. 


a 


2 

X 



total signal power 



dc power 


or 


<t? = 


x 2 f{x) dx — m 2 


(2.49) 



Figure 2.5 A periodic signal and its density and distribution functions 


DRILL PROBLEM 2.14 | 

(a) Refer to Figure 2.5. Compute the variance from x(t) itself. 

(b) Refer to Figure 2.5. Compute the variance from its density function f(x). 

Answers: (a) 0.75 (b) 0.75 


2.7.9 Stationary, Ergodic, and Pseudorandom Signals 

A random signal is called stationary if its statistical features do not change over time. Thus, different (non¬ 
overlapping) segments of a single realization are more or less identical in the statistical sense. Signals that are 
non-stationary do not possess this property and may indeed exhibit a trend (a linear trend, for example) 
with time. Stationarity suggests a state of statistical equilibrium akin to the steady-state for deterministic 
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situations. A stationary process is typically characterized by a constant mean and constant variance. The 
statistical properties of a stationary random signal may be found as ensemble averages across the process 
by averaging over all realizations at one specific time instant or as time averages along the process by 
averaging a single realization over time. The two are not always equal. If they are, a stationary process is 
said to be ergodic. The biggest advantage of ergodicity is that we can use features from a single realization 
to describe the whole process. It is very difficult to establish whether a stationary process is ergodic but, 
because of the advantages it offers, ergodicity is often assumed in most practical situations! For an ergodic 
signal, the mean equals the time average, and the variance equals the ac power (the power in the signal with 
its dc component removed). 

2.7.10 Statistical Estimates 

Probability theory allows us to fully characterize a random signal from an a priori knowledge of its probability 
distribution. This yields features like the mean and variance of the random variable. In practice, we are 
faced with exactly the opposite problem of finding such features from a set of discrete data, often in the 
absence of a probability distribution. The best we can do is get an estimate of such features and perhaps 
even the distribution itself. This is what statistical estimation achieves. The mean and variance are typically 
estimated directly from the observations Xk, k = 0,1, 2,..., N — 1 as 

1 N—i i N-l 

m * = 77 X! Xk a * = X! ( Xk ~ TO *) 2 ( 2 - 5 °) 


Histograms 

The estimates fk of a probability distribution are obtained by constructing a histogram from a large number 
of observations. A histogram is a bar graph of the number of observations falling within specified amplitude 
levels, or bins , as illustrated in Figure 2.6. 


Number of observations 
-H Bin width 



Histogram of a uniform random signal 
Figure 2.6 Histograms of a uniformly distributed and a normally distributed random signal 


Pseudorandom Signals 

In many situations, we use artificially generated signals (which can never be truly random) with prescribed 
statistical features called pseudorandom signals. Such signals are actually periodic (with a very long 
period), but over one period their statistical features approximate those of random signals. 

2.7.11 Random Signal Analysis 

If a random signal forms the input to a system, the best we can do is to develop features that describe the 
output on the average and estimate the response of a system under the influence of random signals. Such 
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estimates may be developed either in the time domain or in the frequency domain. 

Signal-to-Noise Ratio 

For a noisy signal x(t) = s(t) +An(t ) with a signal component s(t) and a noise component An[t) (with noise 
amplitude A), the signal-to-noise ratio (SNR) is the ratio of the signal power a 2 and noise power A 2 a 2 
and usually defined in decibels (dB) as 

SNR = 10 log dB (2.51) 

The decibel value of a is defined as 20 log a. We can adjust the SNR by varying the noise amplitude A. 

Application: Coherent Signal Averaging 

Coherent signal averaging is a method of extracting signals from noise and assumes that the experiment can 
be repeated and the noise corrupting the signal is random (and uncorrelated). Averaging the results of many 
runs tends to average out the noise to zero, and the signal quality (or signal-to-noise ratio) improves. The 
more the number of runs, the smoother and less noisy the averaged signal. We often remove the mean or any 
linear trend before averaging. Figure 2.7 shows one realization of a noisy sine wave and the much smoother 
results of averaging 8 and 48 such realizations. This method is called coherent because it requires time 
coherence (time alignment of the signal for each run). It relies, for its success, on perfect synchronization of 
each run and on the statistical independence of the contaminating noise. 


(a) One realization of noisy sine (b) Average of 8 realizations (c) Average of 48 realizations 



0 5 10 0 5 10 0 5 10 

Time Time Time 


Figure 2.7 Coherent averaging of a noisy sine wave 
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CHAPTER 2 PROBLEMS 


2.1 (Discrete Signals) Sketch each signal and find its energy or power as appropriate. 

(a) x[n] = { 6 , 4, 2, 2} (b) y[n] = {-3, -2, -1, 0, 1} 

(c) f[n] = {0, 2, 4, 6 } (d) g[n] = u[n ] - u[n - 4] 

(e) p[n] = cos(?r 7 r/ 2 ) (f) q[n] = 8(0.5)”u[?r] 

[Hints and Suggestions: Only p[n] is a power signal. The rest have finite energy.] 

2.2 (Signal Duration) Use examples to argue that the product of a right-sided and a left-sided discrete¬ 
time signal is always time-limited or identically zero. 

[Hints and Suggestions: Select simple signals that either overlap or do not overlap.] 

Jf 

2.3 (Operations) Let x[n\ = { 6 , 4, 2, 2}. Sketch the following signals and find their signal energy. 


(a) y[n] = x[n — 2] (b) f[n] = x[n + 2] (c) g[n] = x[—n + 2] (d) h[n] = x[—n — 2] 

[Hints and Suggestions: Note that </[n] is a folded version of f[n].] 

2.4 (Operations) Let x[n\ = 8(0.5)"(u[n + 1] — u[n — 3]). Sketch the following signals. 


(a) y[n] = x\n — 3] (b) f[n] = x[n + 1] (c) g[n] = x[—n + 4] (d) h[n ] = x[—n — 2] 

[Hints and Suggestions: Note that x [n] contains 5 samples (from n = -1 to n = 3). To display the 
marker for y[n) (which starts at n = 2 ), we include two zeros at n = 0 (the marker) and n = 1 .] 


2.5 (Energy and Power) Classify the following as energy signals, power signals, or neither and find the 
energy or power as appropriate. 

(a) x[n ] = 2 n u[—n] 

(d) g[n\ = cos(n7r/2) 


(g) 


1 


(b) y[n] = 2 n u[—n — 1] 
(e) p[n] = — u[n — 1] 


(c) f[n] = cos(n7r) 

(f) q[n] = ~^=u[n — 1] 


i[n — 1 ] (h) s[n] 


/n 

7n7r/2 


(j) t[n) = e (J+ 1 )"’ r / 4 


(k) v[n] = j"/ 4 


(i) d[n\ = 

(1) w[n] = (Vj) n + (Vj)~ n 

2 2n = 4™ = (0.25) - ™. Sum this from n = —oo to n = 0 


[Hints and Suggestions: For x[n] and y[n 
(or n = —1) using a change of variable (n —»■ —n) in the summation. For p[n\, sum 1/n 2 over n = 1 
to n = oo using tables. For q[n], the sum of 1/n from n = 1 to n = oo does not converge! For t[n], 
separate the exponentials. To compute the power for s[n] and d[n], note that |s[n]| = |d[n]| = 1. For 
v[n], use j = e J7r / 2 . For w[n], set yfj = eand use Euler’s relation to convert to a sinusoid.] 


2.6 (Energy and Power) Sketch each of the following signals, classify as an energy signal or power 
signal, and find the energy or power as appropriate. 

OO 

(a) x[n] = y[n — kN ], where y[n] = u[n] — u[n — 3] and N = 6 

k— —oo 
oo 

(b) f[n}= Y, (2)” _5fc (u[n — 5k] — u[n — 5k — 4]) 

k— —oo 
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[Hints and Suggestions: The period of x[n\ is N = 6. With y[n] = u[n ] — u[n — 3], one period of 
x[n] (starting at n = 0) is {1, 1, 1, 0, 0, 0}. The period of f[n} is N = 5. Its one period (starting at 
n = 0) contains four samples from 2 n (u[n] — u[n — 4]) and one trailing zero.] 

4 

2.7 (Decimation and Interpolation) Let x[n] = {4, 0, 2, —1, 3}. Find and sketch the following 
signals and compare their signal energy with the energy in x\n\. 

(a) The decimated signal d[n ] = x[2.n] 

(b) The zero-interpolated signal f[n] = x[^] 

(c) The step-interpolated signal g[n] = x[^\ 

(d) The linearly interpolated signal h{n ] = x[^} 

[Hints and Suggestions: To get d[n], retain the samples of x[n] at n = 0, ±2, ±4,.... Assuming that 
the interpolated signals will be twice the length of x[n], the last sample will be 0 for f[n], 3 for g[n] 
and 1.5 (the linearly interpolated value with x[n] = 0, n > 2) for h[n].\ 

2.8 (Interpolation and Decimation) Let x[n\ = 4tri(n/4). Sketch the following signals and describe 
how they differ. 

(a) x[|n], using zero interpolation followed by decimation 

(b) x[^n], using step interpolation followed by decimation 

(c) x[|n], using decimation followed by zero interpolation 

(d) x[|n], using decimation followed by step interpolation 

2.9 (Fractional Delay) Starting with x[n], we can generate the signal x[n — 2] (using a delay of 2) or 
x[2n — 3] (using a delay of 3 followed by decimation). However, to generate a fractional delay of the 
form x[n — requires a delay, interpolation, and decimation! 

(a) Describe the sequence of operations required to generate x[n — |] from x[n\. 

(b) Let x[n] = {1, 4, 7, 10, 13}. Sketch x[n] and x[n — }]. Use linear interpolation where required. 

(c) Generalize the results of part (a) to generate x[n — }[] from x[n]. Any restrictions on M and TV? 

[Hints and Suggestions: In part (a) the sequence of operations requires interpolation, delay (by 2) 
and decimation. The interpolation and decimation factors are identical.] 

2.10 (Symmetry) Sketch each signal and its even and odd parts. 

(a) x[n ] = 8(0.5)"tt[n] (b) y[n] = u[n] (c) f[n] = 1 + u[n} 

(d) g[n\ = u[n} - u[n - 4] (e) p[n] = tri(^) (f) q[n) = {6, 4, 2, 2} 

[Hints and Suggestions: Confirm the appropriate symmetry for each even part and each odd part. 
For each even part, the sample at n = 0 must equal the original sample value. For each odd part, the 
sample at n = 0 must equal zero.] 

2.11 (Sketching Discrete Signals) Sketch each of the following signals: 

(a) x[n\ = r[n + 2] — r[n — 2] — 4 u[n — 6] (b) y[n] = rect(|) 

(c) f[n] = rect(^) (d) g[n] = 6tri(^) 

[Hints and Suggestions: Note that f[n] is a rectangular pulse centered at n = 2 with 5 samples. Also, 
g[n] is a triangular pulse centered at n = 4 with 7 samples (including the zero-valued end samples).] 
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2.12 (Sketching Signals) Sketch the following signals and describe how they are related. 

(a) x[n] = <5[n] (b) f[n ] = rect(?r) (c) g[n] = tri(n) (d) h[n] = sinc(?i) 

2.13 (Signal Description) For each signal shown in Figure P2.13, 

(a) Write out the numeric sequence, and mark the index n = 0 by an arrow. 

(b) Write an expression for each signal using impulse functions. 

(c) Write an expression for each signal using steps and/or ramps. 

(d) Find the signal energy. 

(e) Find the signal power, assuming that the sequence shown repeats itself. 



Figure P2.13 Signals for Problem 2.13 


[Hints and Suggestions: In part (c), all signals must be turned off (by step functions) and any 
ramps must be first flattened out (by other ramps) . For example, signal 3 = r[n] — r[ri — 5] — 5 u[n — 6]. 
The second term flattens out the first ramp and last term turns the signal off after n = 5.] 

2.14 (Discrete Exponentials) A causal discrete exponential has the form x[n ] = a n u[n}. 

(a) Assume that a is real and positive. Pick convenient values for a > 1, a = 1, and a < 1; sketch 
x[n\; and describe the nature of the sketch for each choice of a. 

(b) Assume that a is real and negative. Pick convenient values for a < —1, a = —1, and a > —1; 
sketch x[n]\ and describe the nature of the sketch for each choice of a. 

(c) Assume that a is complex and of the form a = Ae ^ 6 , where A is a positive constant. Pick 

convenient values for 6 and for A < 1, A = 1, and A > 1; sketch the real part and imaginary 

part of x[n\ for each choice of A ; and describe the nature of each sketch. 

(d) Assume that a is complex and of the form a = AeJ e , where A is a positive constant. Pick 

convenient values for 6 and for A < 1, A = 1, and A > 1; sketch the magnitude and imaginary 

phase of :r[n] for each choice of A; and describe the nature of each sketch. 

2.15 (Signal Representation) The two signals shown in Figure P2.15 may be expressed as 

(a) x[n] = Aa n («[ii] — u[n — IV]) (b) y[n] = Acos(2TrFn+ 6) 

Find the constants in each expression and then find the signal energy or power as appropriate. 

Figure P2.15 

[Hints and Suggestions: For y\n\, first find the period to compute F. Then, evaluate y[n\ at two 
values of n to get two equations for, say j/[0] and y[l]. These will yield 6 (from their ratio) and A.] 



1 2 3 4 5 
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2.16 (Discrete-Time Harmonics) Check for the periodicity of the following signals, and compute the 
common period N if periodic. 


( a ) 

x[n] '■ 

= c.os( T f) 


(b) 

y[ n ) 

= cos(|) 

(c) 

/[«] : 

= sin(^)- 

~2cos(^f) 

(d) 

9[n\ 

= 2cos(^f) + cos 2 (^) 

(e) 

p[n\ -- 

= 4 — 3 sin( 

7nn \ 

4 / 

(f) 

q[n\ 

= cos(^f) + cos(^) 

(g) 

r[n\ - 

= cos(|n7r) 

+ cos(|n) 

(h) 

s[n] 

= cos(^)cos(^) 

(i) 

d[n] = 

_ e j0.3nir 


0) 

e[n] 

_ 2gf0.3n7r OAnn 

(k) 

v[n] - 

= e j0.3n 


(1) 

w[n } 

= U) n/2 


[Hints and Suggestions: There is no periodicity if F is not a rational fraction for any component. 
Otherwise, work with the periods and find their LCM. For w[n], note that j = ed 7 ^ 2 .] 

2.17 (The Roots of Unity) The N roots of the equation z N = 1 can be found by writing it as z N = e j2fc7r 
to give z = e^ k7r l N , k = 0,1,..., N — 1. What is the magnitude and angle of each root? The roots 
can be displayed as vectors directed from the origin whose tips lie on a circle. 

(a) What is the length of each vector and the angular spacing between adjacent vectors? Sketch for 
N = 5 and N = 6. 

(b) Extend this concept to find the roots of z N = — 1 and sketch for N = 5 and N = 6. 

[Hints and Suggestions: In part (b), note that z N = —1 = e? 7r e : ' 2fc7r = e J ( 2fe + 1 ) 7r .] 

2.18 (Digital Frequency) Set up an expression for each signal, using a digital frequency \F\ < 0.5, and 
another expression using a digital frequency in the range 4 < F < 5. 

(a) x[n] = cos(^) (b) x[n] = sin(^) + 3sin(^f) 

[Hints and Suggestions: First find the digital frequency of each component in the principal range 
(—0.5 < F < 0.5). Then, add 4 or 5 as appropriate to bring each frequency into the required range.] 

2.19 (Digital Sinusoids) Find the period N of each signal if periodic. Express each signal using a digital 
frequency in the principal range (|Fj < 0.5) and in the range 3 < F < 4. 

(a) x[n] = cos(^p) (b) x[n] = cos(^p) + sin(0.5ri7r) (c) x[n\ = cos (n) 

2.20 (Sampling and Aliasing) Each of the following sinusoids is sampled at S = 100 Hz. Determine if 
aliasing has occurred and set up an expression for each sampled signal using a digital frequency in the 
principal range (\F\ < 0.5). 

(a) x(t) = cos(3207rf + J) (b) x(t) = cos(1407rt — j) (c) x(t) = sin(607rf) 

[Hints and Suggestions: Find the frequency /o- If S' > 2/o there is no aliasing and F < 0.5. 
Otherwise, bring F into the principal range to write the expression for the sampled signal.] 

2.21 (Aliasing and Signal Reconstruction) The signal x(t) = cos(3207rt + J) is sampled at 100 Hz, 
and the sampled signal x[n] is reconstructed at 200 Hz to recover the analog signal x r (t). 

(a) Has aliasing occurred? What is the period N and the digital frequency F of x [n] ? 

(b) How many full periods of x(t) are required to generate one period of x[n\l 

(c) What is the analog frequency of the recovered signal x r (t)l 

(d) Write expressions for x[n] (using |F| < 0.5) and for x r {t). 
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[Hints and Suggestions: For part (b), if the digital frequency is expressed as F = k/N where N 
is the period and k is an integer, it takes k full cycles of the analog sinusoid to get N samples of 
the sampled signal. In part (c), the frequency of the reconstructed signal is found from the aliased 
frequency in the principal range.] 

2.22 (Digital Pitch Shifting) One way to accomplish pitch shifting is to play back (or reconstruct) a 
sampled signal at a different sampling rate. Let the analog signal x(t) = sin(158007rf + 0 . 257 t) be 
sampled at a sampling rate of 8 kHz. 

(a) Find its sampled representation with digital frequency |F| < 0.5. 

(b) What frequencies are heard if the signal is reconstructed at a rate of 4 kHz? 

(c) What frequencies are heard if the signal is reconstructed at a rate of 8 kHz? 

(d) What frequencies are heard if the signal is reconstructed at a rate of 20 kHz? 

[Hints and Suggestions: The frequency of the reconstructed signal is found from the aliased digital 

frequency in the principal range and the appropriate reconstruction rate.] 

2.23 (Discrete-Time Chirp Signals) Consider the signal x(t) = cos[</>(f)], where = at 2 . Show that 

its instantaneous frequency /,(t) = j>'(t ) varies linearly with time. 

(a) Choose a such that the frequency varies from 0 Hz to 2 Hz in 10 seconds, and generate the 
sampled signal x[n} from x(t), using a sampling rate of S' = 4 Hz. 

(b) It is claimed that, unlike x(t), the signal x[n\ is periodic. Verify this claim, using the condition 
for periodicity (x[n] = x[n + IV]), and determine the period N of x[n}. 

(c) The signal y[n] = cos(irF 0 n 2 /M), n = 0,1,..., M — 1, describes an M-sample chirp whose digital 
frequency varies linearly from 0 to F 0 . What is the period of y[n] if F 0 = 0.25 and M = 8? 

[Hints and Suggestions: In part (b), if x[n\ = cos (/3n 2 ), periodicity requires x[n] = x[n + IV] or 
cos (/3n 2 ) = cos [P(n 2 + 2nJV + IV 2 )]. Thus 2nN/3 = 2rmr and N 2 f3 = 2kn where m and k are integers. 
Satisfy these conditions for the smallest integer TV.] 

2.24 (Time Constant) For exponentially decaying discrete signals, the time constant is a measure of 
how fast a signal decays. The 60-dB time constant describes the (integer) number of samples it takes 
for the signal level to decay by a factor of 1000 (or 20log 1000 = 60 dB). 

(a) Let x[n] = (0.5)"w[n]. Compute its 60-dB time constant and 40-dB time constant. 

(b) Compute the time constant in seconds if the discrete-time signal is derived from an analog signal 
sampled at 1 kHz. 

2.25 (Signal Delay) The delay I? of a discrete-time energy signal x[n] is defined by 

OO 

J2 kx2 W\ 

k ——oo 
oo 

2:2 w 

fc= — oo JJ. 

(a) Verify that the delay of the symmetric sequence x[n] = {4,3,2,1,0,1,2,3,4} is zero. 

(b) Compute the delay of the signals g[n] = x[n — 1] and h[n] = x[n — 2], 

(c) What is the delay of the signal y[n] = 1.5(0.5)"w[n] — 2<5[n]? 

[Hints and Suggestions: For part (c), compute the summations required in the expression for the 
delay by using tables and the fact that y[n] = —0.5 for n = 0 and y[n] = 1.5(0.5)" for n > 1.] 
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2.26 (Periodicity) It is claimed that the sum of an absolutely summable signal x[n] and its shifted (by 
multiples of N) replicas is a periodic signal x p [n] with period N. Verify this claim by sketching the 
following and, for each case, compute the power in the resulting periodic signal x p [n\ and compare the 
sum and energy of one period of x p [n] with the sum and energy of x[n]. 

(a) The sum of x[n ] = tri(n/3) and its replicas shifted by N = 7 

(b) The sum of x[n ] = tri(n/3) and its replicas shifted by N = 6 

(c) The sum of x[n ] = tri(n/3) and its replicas shifted by N = 5 

(d) The sum of x[n] = tri(n/3) and its replicas shifted by N = 4 

(e) The sum of x[n] = tri(n/3) and its replicas shifted by N = 3 

2.27 (Periodic Extension) The sum of an absolutely summable signal x[n] and its shifted (by multiples 
of N) replicas is called the periodic extension of x[n] with period N. 

(a) Show that one period of the periodic extension of the signal x[n] = a n u[n ] with period N is 

a n 

y[n] = z - w , 0 < n < N — 1 

1 — cr v 

(b) How does the sum of one period of the periodic extension y[n] compare with the sum of x [n] ? 

(c) With a = 0.5 and N = 3, compute the signal energy in x[n] and the signal power in y[n\. 

[Hints and Suggestions: For one period (n = 0 to n = N — 1), only x[n] and the tails of the replicas 
to its left contribute. So, find the sum of x[n + kN ] = a n+kN only from k = 0 to k = oo.] 

2.28 (Signal Norms) Norms provide a measure of the size of a signal. The p-norm, or Holder norm, 
||cc||p for discrete signals is defined by ||ar||p = (X] \x\ p ) 1 ^ p , where 0 < p < oo is a positive integer. For 
p = oo, we also define Ha^oo as the peak absolute value |x| max . 

(a) Let x[n\ = {3, -j4, 3 + j4}. Find ||x||i, ||x|| 2 , and ||x||oo. 

(b) What is the significance of each of these norms? 


COMPUTATION AND DESIGN 


2.29 (Discrete Signals) 


For each part, plot the signals x [n] and y[n] over — 10<n<10 and compare. 


(a) x[n] = u[n + 4] — u[n — 4] + 2 6[n + 6] — 5[n — 3] 

(b) x[n] = r[n + 6] — r[n + 3] — r[n — 3] + r[n — 6] 

(c) x[n] = rect(jg) — rect( 23 ^) 

(d) x[n] = 6tri(f) 3 tri(f) 


y[n] = x[—n — 4] 
y[n) = x[n — 4] 
y[n] = x[n + 4] 
y[n) = x[—n + 4] 


2.30 (Signal Interpolation) Let h[n\ = sin(?r7r/3), 0 < n < 10. Plot the signal h[n\. Use this to 

generate and plot the zero-interpolated , step-interpolated , and linearly interpolated signals assuming 
interpolation by 3. 


2.31 (Discrete Exponentials) A causal discrete exponential may be expressed as x[n] = a n u[n .], where 
the nature of a dictates the form of x[n\. Plot the following over 0 < n < 40 and comment on the 
nature of each plot. 

(a) The signal x[n] for a = 1.2, a = 1, and a = 0.8. 

(b) The signal x[n] for a = —1.2, a = —1, and a = —0.8. 
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(c) The real part and imaginary parts of x[n\ for a = Ae ? 7r / 4 , with A = 1.2, A = 1, and A = 0.8. 

(d) The magnitude and phase of x[n] for a = AeP 71 ' 4 , with A = 1.2, A = 1, and A = 0.8. 

2.32 (Discrete-Time Sinusoids) Which of the following signals are periodic and with what period? Plot 
each signal over —10 < n < 30. Do the plots confirm your expectations? 

(a) x[n] = 2cos( z y : ) + 5sin(^) (b) x[n] = 2cos( ! rr) sin(^) 

(c) x[n] = cos(0.5n) (d) x[n ] = 5sin(^ + f) — 5cos(^ - f) 

2.33 (Complex-Valued Signals) A complex-valued signal x[n] requires two plots for a complete descrip¬ 
tion in one of two forms—the magnitude and phase vs. n or the real part vs. n and imaginary part 
vs. n. 

4 

(a) Let x[n) = {2, 1 + j, —j 2, 2 — j 2, —4}. Sketch each form for x[n] by hand. 

(b) Let x[n\ = e l 0 - 3 "’ 1 ’. Use Matlab to plot each form over —30 < n < 30. Is x[n\ periodic? If so, 
can you identify its period from the Matlab plots? From which form, and how? 

2.34 (Complex Exponentials) Let x[n] = 5v / 2e- , ^” 5__T ). Plot the following signals and, for each case, 
derive analytic expressions for the signals plotted and compare with your plots. Is the signal x [n] 
periodic? What is the period N ? Which plots allow you determine the period of x[n\? 

(a) The real part and imaginary part of x[n\ over —20 < n < 20 

(b) The magnitude and phase of x[n] over —20 < n < 20 

(c) The sum of the real and imaginary parts over —20 < n < 20 

(d) The difference of the real and imaginary parts over —20 < n < 20 

2.35 (Complex Exponentials) Let x[n] = (\/J) n + ( \/j)~ n ■ Plot the following signals and, for each case, 
derive analytic expressions for the sequences plotted and compare with your plots. Is the signal x [n] 
periodic? What is the period V? Which plots allow you determine the period of x[n}7 

(a) The real part and imaginary part of x[n\ over —20 < n < 20 

(b) The magnitude and phase of x[n] over —20 < n < 20 


2.36 


(Discrete-Time Chirp Signals) An iV-sample chirp signal x [n] whose digital frequency varies 
linearly from Fq to F\ is described by 


x[n] = cos 


27T FqU - 


F\ — F 0 
2 N 



n = 0,1,...,V—1 


(a) Generate and plot 800 samples of a chirp signal x whose digital frequency varies from F = 0 to 
F = 0.5. Using the Matlab based routine timefreq (from the author’s website), observe how 
the frequency of x varies linearly with time. 

(b) Generate and plot 800 samples of a chirp signal x whose digital frequency varies from F = 0 to 
F = 1. Is the frequency always increasing? If not, what is the likely explanation? 


2.37 (Chirp Signals) It is claimed that the chirp signal x[n\ = cos(7rn 2 /6) is periodic (unlike the analog 
chirp signal x(t) = cos(7rf 2 /6)). Plot x[n] over 0 < n < 20. Does x[n] appear periodic? If so, can you 
identify the period TV? Justify your results by trying to find an integer N such that x[n] = x[n + V] 
(the basis for periodicity). 

2.38 (Signal Averaging) Extraction of signals from noise is an important signal-processing application. 
Signal averaging relies on averaging the results of many runs. The noise tends to average out to zero, 
and the signal quality or signal-to-noise ratio (SNR) improves. 
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(a) Generate samples of the sinusoid x(t) = sin(8007rt) sampled at S = 8192 Hz for 2 seconds. The 
sampling rate is chosen so that you may also listen to the signal if your machine allows. 

(b) Create a noisy signal s[n] by adding x[n] to samples of uniformly distributed noise such that s[n] 
has an SNR of 10 dB. Compare the noisy signal with the original and compute the actual SNR 
of the noisy signal. 

(c) Sum the signal s[n] 64 times and average the result to obtain the signal s a [n]. Compare the 
averaged signal s 0 [n], the noisy signal s[n], and the original signal x[n]. Compute the SNR of 
the averaged signal x a [n\. Is there an improvement in the SNR? Do you notice any (visual and 
audible) improvement? Should you? 

(d) Create the averaged result Xb[n] of 64 different noisy signals and compare the averaged signal 
Xb[n] with the original signal x[n\. Compute the SNR of the averaged signal Xb[n]. Is there an 
improvement in the SNR? Do you notice any (visual and/or audible) improvement? Explain how 
the signal Xb[n] differs from x a [n}. 

(e) The reduction in SNR is a function of the noise distribution. Generate averaged signals, using 
different noise distributions (such as Gaussian noise) and comment on the results. 

2.39 (The Central Limit Theorem) The central limit theorem asserts that the sum of independent noise 
distributions tends to a Gaussian distribution as the number N of distributions in the sum increases. 
In fact, one way to generate a random signal with a Gaussian distribution is to add many (typically 6 
to 12) uniformly distributed signals. 

(a) Generate the sum of uniformly distributed random signals using N = 2, N = 6, and N = 12 and 
plot the histograms of each sum. Does the histogram begin to take on a Gaussian shape as N 
increases? Comment on the shape of the histogram for N = 2. 

(b) Generate the sum of random signals with different distributions using N = 6 and N = 12. Does 
the central limit theorem appear to hold even when the distributions are not identical (as long 
as you select a large enough AT)? Comment on the physical significance of this result. 

2.40 (Music Synthesis I) A musical composition is a combination of notes, or signals, at various frequen¬ 
cies. An octave covers a range of frequencies from /o to 2/o- In the western musical scale, there are 12 
notes per octave, logarithmically equispaced. The frequencies of the notes from /o to 2/o correspond 
to 

/ = 2 fc / 12 / 0 * = 0 , 1 , 2,...,11 

The 12 notes are as follows (the ® and b stand for sharp and flat, and each pair of notes in parentheses 
has the same frequency): 

A (A# or B b ) B C (C # or D b ) D (D« or E b ) E F (F« or G b ) G (G # or A b ) 

An Example: Raga Malkauns: In Indian classical music, a raga is a musical composition based on 
an ascending and descending scale. The notes and their order form the musical alphabet and grammar 
from which the performer constructs musical passages, using only the notes allowed. The performance 
of a raga can last from a few minutes to an hour or more! Raga malkauns is a pentatonic raga (with 
five notes) and the following scales: 

Ascending: D F G B b C D Descending: C B b G F D 

The final note in each scale is held twice as long as the rest. To synthesize this scale in Matlab, we 
start with a frequency fo corresponding to the first note D and go up in frequency to get the notes in 
the ascending scale; when we reach the note D, which is an octave higher, we go down in frequency to 
get the notes in the descending scale. Here is a Matlab code fragment. 
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f0=340; d=f0; 7. Pick a frequency and the note D 

f=f 0* (2~ (3/12) ) ; g=f 0* (2~ (5/12) ) ; */, The notes F and G 

bf=f 0* (2" (8/12) ) ; c=f0*(2~(10/12)); 7. The notes B(flat) and C 
d2=2*d; 7. The note D (an octave higher) 

Generate sampled sinusoids at these frequencies, using an appropriate sampling rate (say, 8192 Hz); 
concatenate them, assuming silent passages between each note; and play the resulting signal, using the 
Matlab command sound. Use the following Matlab code fragment as a guide: 


ts=l/8192; 
t=0:ts:0.4; 
sl=0*(0:ts:0.1); 
s2=0*(0:ts:0.05) ; 
tl=0:ts:1; 
dl=sin(2*pi*d*t); 

fl=sin(2*pi*f*t); gl=sin(2*pi*g*t); 
bfl=sin(2*pi*bf*t); cl=sin(2*pi*c*t); 
dll=sin(2*pi*d2*tl); dl2=sin(2*pi*d*tl); 
asc=[dl si fl si gl si bfl si cl s2 dll] 
dsc=[cl si bfl si gl si fl si dl2]; 
y=[asc si dsc si]; sound(y) 


7. Sampling interval 
/ Time for each note (0.4 s) 

/ Silent period (0.1 s) 

/ Shorter silent period (0.05 s) 

7. Time for last note of each scale 
7. Start generating the notes 


; 7. Create ascending scale 
7. Create descending scale 
7. Malkauns scale (y) 


2.41 (Music Synthesis II) The raw scale of raga malkauns will sound pretty dry! The reason for 
this is the manner in which the sound from a musical instrument is generated. Musical instruments 
produce sounds by the vibrations of a string (in string instruments) or a column of air (in woodwind 
instruments). Each instrument has its characteristic sound. In a guitar, for example, the strings are 
plucked, held, and then released to sound the notes. Once plucked, the sound dies out and decays. 
Furthermore, the notes are never pure but contain overtones (harmonics). For a realistic sound, we 
must include the overtones and the attack, sustain, and release (decay) characteristics. The sound 
signal may be considered to have the form x(t) = a(t)cos(2nf 0 t + 0), where fo is the pitch and a(t) 
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is the envelope that describes the attack-sustain-release characteristics of the instrument played. A 
crude representation of some envelopes is shown in Figure P2.41 (the piecewise linear approximations 
will work just as well for our purposes). Woodwind instruments have a much longer sustain time and 
a much shorter release time than do plucked string and keyboard instruments. 



Figure P2.41 Envelopes and their piecewise linear approximations (dark) for Problem 2.41 

Experiment with the scale of raga malkauns and try to produce a guitar-like sound, using the appro¬ 
priate envelope form. You should be able to discern an audible improvement. 

2.42 (Music Synthesis III) Synthesize the following notes, using a woodwind envelope, and synthesize 
the same notes using a plucked string envelope. 

F«(0.3) D(0.4) E(0.4) A(l) A(0.4) E(0.4) F«(0.3) D(l) 

All the notes cover one octave, and the numbers in parentheses give a rough indication of their relative 
duration. Can you identify the music? (It is Big Ben.) 

2.43 (Music Synthesis IV) Synthesize the first bar of Pictures at an Exhibition by Mussorgsky, which 
has the following notes: 

A(3) G(3) C(3) D(2) G*(l) E(3) D(2) G*(l) E(3) C(3) D(3) A(3) G(3) 

All the notes cover one octave except the note G*, which is an octave above G. The numbers in 
parentheses give a rough indication of the relative duration of the notes (for more details, you may 
want to listen to an actual recording). Assume that a keyboard instrument (such as a piano) is played. 

2.44 (DTMF Tones) In dual-tone multi-frequency (DTMF) or touch-tone telephone dialing, each number 
is represented by a dual-frequency tone. The frequencies for each digit are listed in Chapter 18. 

(a) Generate DTMF tones corresponding to the telephone number 487-2550, by sampling the sum of 
two sinusoids at the required frequencies at S = 8192 Hz for each digit. Concatenate the signals 
by putting 50 zeros between each signal (to represent silence) and listen to the signal using the 
Matlab command sound. 

(b) Write a Matlab program that generates DTMF signals corresponding to a vector input repre¬ 
senting the digits in a phone number. Use a sampling frequency of S = 8192 Hz. 
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TIME-DOMAIN ANALYSIS 


3.0 Scope and Objectives 

Systems that process discrete-time signals are called discrete-time systems or digital filters. Their math¬ 
ematical description relies heavily on how they respond to arbitrary or specific signals. This chapter starts 
with the classification of discrete systems and introduces the important concepts of linearity and time invari¬ 
ance. It presents the analysis of discrete-time systems described by difference equations. It concludes with 
the all-important concept of the impulse response and the process of convolution that forms an important 
method for finding the response of linear, time-invariant systems. 


3.1 Discrete-Time Systems 

In the time domain, many discrete-time systems can be modeled by difference equations relating the 
input and output. Difference equations typically involve input and output signals and their shifted versions. 
For example, the system described by y [n] == ay[n — 1] + f3x [n] produces the present output y[n] as the sum 
of the previous output y[n — 1] and the present input x[n}. The quantities a and (3 are called coefficients. 
Linear, time-invariant (LTI) systems are characterized by constant coefficients. Such systems have been 
studied extensively and their response can be obtained by well established mathematical methods. 

3.1.1 Linearity and Superposition 

An operator allows us to transform one function to another. If an operator is represented by the symbol O, 
the equation 

0{x[n\} = y[n] (3.1) 

implies that if the function x[n\ is treated exactly as the operator O tells us, we obtain the function y [n]. The 
forward shift operator z k describes an advance of k units and transforms x[n] to x[n + k]. We express this 
transformation in operator notation as z k {x[n}} = x[n + k]. The backward shift operator z~ k describes 
a delay of k units and transforms x[n] to x[n — k\. In operator notation, we have z~ k {x[n]} = x[n — k]. 
The unit delay operator is represented by z _1 and transforms x[n\ to x[n — 1]. In operator notation, 
z~ 1 {x[n ]} = x[n— 1]. An operation may describe several steps. For example, the operation 0{ } = 4,z~ 3 { }+6 
says that to get y[n], we must delay x[n] by 3 units, multiply the result by 4, and then add 6 to finally obtain 
4,z~ 3 {x[n]} + 6 = 4 x[n — 3] + 6 = y[n ]. 

If an operation on the sum of two functions is equivalent to the sum of operations applied to each 
separately, the operator is said to be additive. In other words, 

0{xi[n] + X 2 [n]} = 0{xi[n]} + 0{x2[n]} (for an additive operation) (3.2) 


46 
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If an operation on Kx[n] is equivalent to K times the linear operation on x\n\ where K is a scalar, the 
operator is said to be homogeneous. In other words, 

0{Kx[n]} = KO{x[n]} (for a homogeneous operation) (3.3) 

Together, the two results describe the principle of superposition. An operator O is termed a linear 
operator if it obeys superposition and is therefore both additive and homogeneous: 

0{Ax\[n] + Bx 2 [n}} = AO{x\[n}} + BO{x 2 [n]} (for a linear operation) (3.4) 

If a system fails the test for either additivity or homogeneity, it is termed nonlinear. It must pass both 
tests in order to be termed linear. However, in many instances, it suffices to test only for homogeneity or 
additivity to confirm the linearity of an operation (even though one does not imply the other). An important 
concept that forms the basis for the study of linear systems is that the superposition of linear operators is 
also linear. 


REVIEW PANEL 3.1 

A Linear Operator Obeys Superposition: aO{x\[n]} + bO{x 2 [n]} = 0{ax\[n\ + bx 2 [n]} 

Superposition implies both homogeneity and additivity. 

Homogeneity: 0{ax[n\} = aO{x[n\\ Additivity: 0{xi[n]} + 0{x 2 [n]} = 0{xi[n] + x 2 [n]} 


EXAMPLE 3.1 (Testing for Linear Operators) 

(a) Consider the operator 0{ } = C{ } + D. 

By the homogeneity test, 0{Ax[n ]} = ACx[n\ + D , but AO{x[n]} = A(Cx[n] + D) = ACx[n\ + AD. 
The two differ, so the operation is nonlinear (it is linear only if D = 0). 


(b) Consider the squaring operator 0{ } = {}“, which transforms x[n] to x 2 [n]. 

By the homogeneity test, AO{x[n]} = Ax 2 [n}, but 0{Ax[n]} = ( Ax[n ]) 2 = A 2 x 2 [n]. 
The two are not equal, and the squaring operator is nonlinear. 


DRILL PROBLEM 3.1 

Which of the following operations are linear? 

(a) 0{ } = cos{ } (b) 0{ } = log{ } (c) 0{x[n\} = a n {x[n ]} 

Answers: Only (c) is linear. 


3.1.2 Time Invariance 

Time invariance implies that the shape of the response y[n\ depends only on the shape of the input x\n\ 
and not on the time when it is applied. If the input is shifted to x[n — no], the response equals y[n — no] 
and is shifted by the same amount. In other words, the system does not change with time. Formally, if the 
operator O transforms the input x[n] to the output y[n\ such that 0{a:[n]} = y[n\, time invariance means 

0{x[n — no]} = y[n — no] (for time invariance) (3-5) 

In other words, if the input is delayed by no units, the output is also delayed by the same amount and 
is simply a shifted replica of the original output. 
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REVIEW PANEL 3.2 

Time Invariance from the Operational Relation 

If C>{a;[?r]} = y[n\, then 0{x[n — ?Zq)} = y[n — no] (shift input by a => shift output by a). 


EXAMPLE 3.2 (Linearity and Time Invariance of Operators) 

(a) y[n] = a:[n]a;[n — 1] is nonlinear but time invariant. 

The operation is 0{ } = ({ })(z -1 { })• We find that 

AO{x[n]} = A{x[n\x[n — 1]), but 0{Ax[n ]} = {Ax[n\){Ax[n — 1]). The two are not equal. 

0{x[n — no]} = x[n — no]a:[n — no — 1], and y[n — no] = x[n — no]a:[n — no — 1]. The two are equal. 


(b) y[n] = nx[n\ is linear but time varying. 

The operation is 0{ } = n{ }. We find that 

AO{x[n\} = A(nx[n\), and 0{Ax[n ]} = n(Ax[n]). The two are equal. 

0{x[n — no]} = n{x[n — no]), but y[n — no] = (n — no)x[n — no]. The two are not equal. 


(c) y[n] = x[2n] is linear but time varying. The operation n => 2n reveals that 
AO{x[n]} = A(x[2n]), and 0{Ax[n\] = (Ax[2n\). The two are equal. 

0{x[n — no]} = x[2n — no], but y[n — no] = x[2 (n — no)]. The two are not equal. 


(d) y [n] = x[n — 2] is linear and time invariant. The operation n => n — 2 reveals that 
AO{x[n}} = A(x[n — 2]), and 0{Ax[n]} = (Ax[n — 2]). The two are equal. 

0{x[n — no]} = x[n — no — 2], and y[n — no] = x[n — no — 2]. The two are equal. 


(e) y[n] = 2 a; [ n la;[n] is nonlinear but time invariant. 

The operation is 0{ } = (2)W{ } and reveals that 

AO{x[n\} = A(2) x ^x[n], but 0{Ax[n]} = (2) Ax ^ n \Ax[n}). The two are not equal. 

0{x[n — no]} = ( 2)A n ~ n °^x[n — no], and y[n — no] = (2)A n ~ n °^x[n — no]. The two are equal. 


DRILL PROBLEM 3.2 

Which of the following operations are time-invariant? 

(a) 0{x[n ]} = cos{cc[n]} (b) 0{x[n\\ = C{x[n]} (c) 0{x[n ]} = C n {x[n ]} 

Answers: (a) and (b) are time-invariant. 
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3.1.3 LTI Systems 

Systems that are both linear and time-invariant are termed LTI (linear, time invariant). We may check for 
linearity or time-invariance by applying formal tests to the system equation as a whole or by looking at 
its individual operations. A difference equation is LTI if all its coefficients are constant (and no constant 
terms are present). Any nonlinear or time-varying behavior is recognized (by generalizing the results of the 
previous example) as follows: 

1. If a constant term is present or a term contains products of the input and/or output, the system 
equation is nonlinear. 

2. If a coefficient is an explicit function of n or a scaled input or output (such as y[2n}) is present, the 
system equation is time varying. 


| REVIEW PANEL 3.3 | 

What Makes a Difference Equation LTI or Nonlinear or Time Varying? 

It is LTI if all coefficients are constant and there are no constant terms. 

It is nonlinear if a term is constant or a nonlinear function of x\n] or y[n\. 

It is time varying if a coefficient is an explicit function of or an input or output is scaled (e.g. y[2n}). 


EXAMPLE 3.3 (Linearity and Time Invariance of Systems) 

We check the following systems for linearity and time invariance. 

(a) y[n] — 2y[n — 1] = 4a c[n]. This is LTI. 

(b) y[n\ — 2ny[n — 1] = x[n}. This is linear but time varying. 

(c) y[n\ + 2y 2 [n\ = 2x[n\ — x[n — 1]. This is nonlinear but time invariant. 

(d) y[n] — 2y[n — 1] = (2) x ^x[n\. This is nonlinear but time invariant. 

(e) y[n\ — 4y[n]y[2n] = x[n\. This is nonlinear and time varying. 


DRILL PROBLEM 3.3 | 

What can you say about the linearity (L) and time-invariance (TI) of the following? 

(a) y[n] + 2y[n — 1] = a;[n] (b) y[n\ + 2 n y[n — 1] = a:[?r] (c) y 2 [n] + 2 n y[n — 1] = x[n\ 

Answers: (a) L and TI (b) L but not TI (c) Not L, not TI 


3.1.4 Causality and Memory 

In many practical situations, we deal with systems whose inputs and outputs are right-sided signals. In a 
causal system, the present response y[n\ cannot depend on future values of the input, such as x[n + 2]. 
Systems whose present response requires knowledge of future values of the input are termed noncausal. 
Consider an LTI system whose input and output are assumed to be right-sided signals. If such a system is 
described by the difference equation 

y[n] + Aiy[n - 1] +-1- A N y[n - N] = B 0 x[n + K) 
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it is causal as long as K < 0. On the other hand, if the system is described by 

y[n + L\ + Ary[n + L — 1] H-+ A L y[n] = B 0 x[n + K] 

it is causal as long as K < L. The reason is that by time invariance, this system may also be described by 

y[n] + Aiy[n — 1] + • • • + A L y[n — L] = B 0 x[n + K - L\ 

For causality, we require K — L < 0 or K < L. It is often easier to check for causality by examining the 
operational transfer function H{z) derived from the difference equation. The general form of such a 
transfer function may be expressed as a ratio of polynomials in z 

W ~ A o2 Q + A^Q- 1 + • • • + Aq_ iZ + A q (3 ' 6) 

Assuming a right-sided input and output, this system is causal if P < Q. 

DRILL PROBLEM 3.4 | 

(a) Which of the two systems are causal? 

y[n] = 2 n+1 x[n\ y[n] = 2 n x[n + 1] 

(b) Find the operational transfer function of each system and determine if it is causal. 

y[n] — 2 y[n — 1] = x[n + 1] y[n + 1] — 2 y[n — 2] = x[n + 1] 

Answers: (a) The first is causal. (b) The second is causal. 


Instantaneous and Dynamic Systems 

If the response of a system at n = no depends only on the input at n = no and not at any other times 
(past or future), the system is called instantaneous or static. The system equation of an instantaneous 
system has the form y[n + a] = Kx[n + a). Note that the arguments of the input and output are identical. 
The response of a dynamic system depends on past (and/or future) inputs. Dynamic systems are usually 
described by (but not limited to) difference equations. The system y[n\ + 0.5 y[n — 1] = x[n} (a difference 
equation) is dynamic. The system y[n] = 3 x[n — 2] is also dynamic (because the arguments of the input and 
output are different) but the system y[n — 2] = 3a;[n — 2] is instantaneous. 

| REVIEW PANEL 3A] 

What Makes a System Noncausal or Dynamic? 

Noncausal if the numerator degree of the operational transfer function exceeds the denominator degree. 
Dynamic if the system equation has a form different from y[n + a] = Kx[n + a]. 


EXAMPLE 3.4 (Causal and Dynamic Systems) 

(a) y[n] = x[n + 2] is noncausal (to find y[0], we need a;[2]) and dynamic ( y[no\ does not depend on x[no] 
but on x[no + 2]). 

(b) y[n + 4] + y[n + 3] = x[n + 2], By time invariance, y[n\ + y[n — 1] = x[n — 2], So it is causal and 
dynamic. 

(c) y[n\ = 2a;[cm] is causal and instantaneous for a = 1, causal and dynamic for a < 1, and noncausal and 
dynamic for a > 1. It is also time varying if a ^ 1. 

(d) y[n\ = 2 (n + l)x[n] is causal, instantaneous and time varying. 
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DRILL PROBLEM 3.5 

Which of the following systems are instantaneous? 

(a) y[n] = 2 n+1 x[n] (b) y[n] = 2 n x[n + 1] (c) y[n] — 2 y[n — 1] = x[n + 1] 

Answers: Only (a) is instantaneous. 


3.2 Digital Filters 

A discrete-time system is also referred to as a digital filter and we shall use this terminology extensively. An 
important formulation for digital filters is based on difference equations. The general form of an Ath-order 
difference equation may be written as 

y[n] + Aiy[n — 1] + • • • + A N y[n — N] = B 0 x[n] + Bix[n — 1] + • • • + B M x[n — M) (3.7) 

The order A describes the output term with the largest delay. It is customary to normalize the leading 
coefficient to unity. The coefficients Ak and Bk are constant for an LTI digital filter. The response depends 
on the applied input and initial conditions that describe its state just before the input is applied. Systems 
with zero initial conditions are said to be relaxed. In general, if an input x[n] to a relaxed LTI system 
undergoes a linear operation, the output y[n] undergoes the same linear operation. Often, an arbitrary 
function may be decomposed into its simpler constituents, the response due to each analyzed separately 
and more effectively, and the total response found using superposition. This approach is the key to several 
methods of filter analysis described in subsequent chapters. An arbitrary signal x[n] can be expressed as a 
weighted sum of shifted impulses. If the input to a discrete-time system is the unit impulse <5[n], the resulting 
output is called the impulse response and denoted h[n]. The impulse response is the basis for finding the 
filter response by a method called convolution. 

3.2.1 Digital Filter Terminology 

An important filter classification is based on the length of its impulse response. Consider a digital filter 
described by the equation 

y[n] = B 0 x[n] + B\x[n — 1] + • • • + Bmx[ti — M] (Non-recursive or FIR filter) (3.8) 

Its present response depends only on the input terms and shows no dependence (recursion) on past values of 
the response. It is called a nonrecursive filter, or a moving average filter, because its response is just a 
weighted sum (moving average) of the input terms. It is also called a finite impulse response (FIR) filter 
because its impulse response is of finite duration (length). In fact the impulse response sequence contains 
sample values that correspond directly to the so called filter coefficients B 
Now consider a digital filter described by the difference equation 

y[n\ + Aiy[n — 1] + • • • + A N y[n — A] = B 0 x[n ] (Recursive, HR or AR Filter) (3.9) 

This describes a recursive filter of order A whose present output depends on its own past values y[n — k] 
and on present value of the input. It is also called an infinite impulse response (HR) filter because its 
impulse response h[n\ (the response to a unit impulse input) is usually of infinite duration. It is also called 
an AR (autoregressive) filter because its output depends (regresses) on its own previous values. 

Finally, consider the most general formulation described by the difference equation 

y[n]+Aiy[n— 1] + - • ■+AM , y[n— A] = B 0 x[n] + Bix[n— 1] + - • ■+Bmx[ti—M] (Recursive or AR.MA Filter) 

(3.10) 
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This is also a recursive filter. It is called an AR.MA (autoregressive, moving average) filter because its 
present output depends not only on its own past values y[n — k] but also on the past and present values of 
the input. In general, the impulse response of such a filter is also of infinite duration. 

| REVIEW PANEL 3J5l 
The Terminology of Digital Filters 

Nonrecursive or FIR: y[n] = Box[n] + Bix[n — 1] + • • • + Bmx[ii — M] 

Recursive, HR or AR: y [n] + A\y\n — 1] H- + Ajqy\n — A] = B 0 x[n] 

Recursive or ARMA: y[n] + A\y[n — 1] + • • • + Ajsiy[n — A] = B 0 x[n] + B\x[n — 1] + • • • + Bmx[h — M] 


3.2.2 Digital Filter Realization 

Digital filters described by linear difference equations with constant coefficients may be realized by using 
elements corresponding to the operations of scaling (or scalar multiplication), shift (or delay), and summing 
(or addition) that naturally occur in such equations. These elements describe the gain (scalar multiplier), 
delay, and summer (or adder), represented symbolically in Figure 3.1. 


Delay Multiplier Summer 



y ["I 

Figure 3.1 The building blocks for digital filter realization 


Delay elements in cascade result in an output delayed by the sum of the individual delays. The operational 
notation for a delay of k units is z~ k . A nonrecursive filter described by 

y[n] = B 0 x[n] + Bix[n — 1] + • • • + B^x[n — A] (3-11) 


can be realized using a feed-forward structure with N delay elements, and a recursive filter of the form 


y[n] = —Aiy[n - 1]- A N y[n - A] + x[n] (3.12) 

requires a feedback structure (because the output depends on its own past values). Each realization is 
shown in Figure 3.2 and requires A delay elements. 


DRILL PROBLEM 3.6 

Sketch the realizations of the following systems 
(a) y[n\ — 0.6 y[n — 1] = x[n] 
Answer: See following figures. 


x 



y [»] 


(b) y[n\ - \y[n - 1] - \y[n - 2] = 4a;[n] 
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Figure 3.2 Realization of a nonrecursive (left) and recursive (right) digital filter 


The general form described by 

y[n] = — Aiy[n — 1] — • • • — Ajyy[n — AT] + Box[n\ + Bix[n — 1] + • • • + B]yx[n — TV] (3.13) 

requires both feed-forward and feedback and may be realized using 2TV delay elements, as shown in Figure 3.3. 
This describes a direct form I realization. 

However, since LTI systems may be cascaded in any order (as we shall learn soon), we can switch the 
feedback and feedforward sections to obtain a canonical realization with only N delays, as also shown in 
Figure 3.3. It is also called a direct form II realization. Other forms that also use only N elements are 
also possible. We discuss various aspects of digital filter realization in more detail in subsequent chapters. 



Figure 3.3 Direct (left) and canonical (right) realization of a digital filter 
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DRILL PROBLEM 3.7 

What is the difference equation of the digital filter whose realization is shown? 



Answer: y[n] — y[n — 1] — 2 y[n — 2] = 2 x[n] — x[n — 1] 


3.3 Response of Digital Filters 

A digital filter processes discrete signals and yields a discrete output in response to a discrete input. Its 
response depends not only on the applied input but also on the initial conditions that describe its state just 
prior to the application of the input. Systems with zero initial conditions are said to be relaxed. Digital 
filters may be analyzed in the time domain using any of the following models: 

The difference equation representation applies to linear, nonlinear, and time-varying systems. For LTI 
systems, it allows computation of the response using superposition even if initial conditions are present. 

The impulse response representation describes a relaxed LTI system by its impulse response h[n\. The 
output y[n\ appears explicitly in the governing relation called the convolution sum. It also allows us to relate 
time-domain and transformed-domain methods of system analysis. 

The state variable representation describes an ?ith-order system by n simultaneous first-order difference 
equations called state equations in terms of n state variables. It is useful for complex or nonlinear systems 
and those with multiple inputs and outputs. For LTI systems, state equations can be solved using matrix 
methods. The state variable form is also readily amenable to numerical solution. We do not pursue this 
method in this book. 

3.3.1 Response of Nonrecursive Filters 

The system equation of a non-recursive filter is 

y[n] = Box[n] + B\x]n — 1] + • • • + Bmx[ti — M] (FIR filter) 

Since the output y[n\ depends only on the input x[n] and its shifted versions, the response is simply a 
weighted sum of the input terms exactly as described by its system equation. 


EXAMPLE 3.5 (Response of Nonrecursive Filters) 

Consider an FIR filter described by y[n\ = 2 x[n\ — 3 x[n — 2]. Find its output y [n] if the input to the system 
is x[n\ = (0.5) n, u[n] and compute y[n\ for n = 1 and n = 2. 

We find that y[n] = 2x[n\ — 3 x[n — 2] = 2(0.5)"w[n] — 3(0.5) n-2 w[n — 2]. 

We get y[ 1] = 2(0.5) 1 = 1 and y[ 2] = 2(0.5) 2 - 3(0.5)° = 0.5 - 3 = -2.5 
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3.3.2 Response of Recursive Filters by Recursion 

The difference equation of a recursive digital filter is 

y[n] + Aiy[n — 1] + • • • + A N y[n — N] = B 0 x[n] + Bix[n — 1] + • • • + B M x[n — M] 

The response shows dependence on its past values as well as values of the input. The output y[n] requires 
the prior values of y[n — 1], y[n — 2], ..., y[n — N], Once known, we can use y[n] and the other previously 
known values to compute y[n + 1] and continue to use recursion to successively compute the values of the 
output as far as desired. Consider the second-order difference equation 

y[n] + Axy[n - 1] + A 2 y[n - 2] = B 0 x[n] + Bix[n - 1] 

To find y[n], we rewrite this equation as follows 

y[n] = — A\y[n — 1] — A 2 y[n — 2] + B 0 x[n] + B\x[n — 1] 

We see that y[n] can be found from its past values y[n — 1] and y[n — 2]. To start the recursion at n = 0, we 
must be given values of j/[— 1] and y[— 2], and once known, values of y[n], n > 0 may be computed successively 
as far as desired. We see that this method requires initial conditions to get the recursion started. In general, 
the response y [n], n > 0 of the iVth-orcler difference equation requires the N consecutive initial conditions 
y[— 1], y[— 2],..., y[— iV]. The recursive approach is effective and can be used even for nonlinear or time 
varying systems. Its main disadvantage is that a general closed form solution for the output is not always 
easy to discern. 


EXAMPLE 3.6 (System Response Using Recursion) 

(a) Consider a system described by y[n] = aiy[n — 1] + b 0 u[n). Let the initial condition be y[— 1] = 0. We 
then successively compute 

y[0] = aiy[-l] + b o u[0] = b 0 

y[ 1] = aiy[0] + b 0 u[l] = aib 0 + b 0 = 6 0 [1 + ai] 

y[ 2] = aiy{\] + b 0 u{2] = ai[aib 0 + b 0 \ + b 0 = b 0 [l + m + a\] 

The form of y[n] may be discerned as 

y[n\ = &o[l + ci± + + • • • + a™ 1 + u”] 

Using the closed form for the geometric sequence results in 

,, mi - «r +1 ) 

»[") = l-a, 

If the coefficients appear as numerical values, the general form may not be easy to discern. 


(b) Consider a system described by y[n] = aiy[n — 1] + b 0 nu[n]. Let the initial condition be y[— 1] = 0. We 
then successively compute 

y[ o] = °i2/[—i] = o 

y[ 1] = aiy[0] + 6 0 u[l] = b 0 

y[ 2] = aiy[ 1] + 26 0 u[2] = aib 0 + 2 b 0 

2/[3] = ai [2] + 3&o^[3] = ai[ui6o T 26 q] + 36q = uj + 2ai6o T 36 q 
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The general form is thus y[n] = a™ 1 + 26 0 a™ 2 + 360 a™ 3 + (n — l)b 0 a\ + nb 0 - 

We can find a more compact form for this, but not without some effort. By adding and subtracting 
boa'i and factoring out a", we obtain 

y[n] = a" — fooa ™ -1 + 60 a" [a ^ 1 + 2 a^ 2 + 3a )~ 3 + • • • + na)~"] 

Using the closed form for the sum S kx k from k = 1 to k = A (with x = a -1 ), we get 


y[n] = a" - 6 0 a" 1 + 


a x [l —(n + l)a n + na ( ra+1 )] 


(1 — a -1 ) 2 

What a chore! More elegant ways of solving difference equations are described later in this chapter. 


(c) Consider the recursive system y[n\ = y[n — 1] + x[n } — x[n — 3]. If x[n] equals <5[n] and y[— 1] = 0, we 
successively obtain 

y[0] = y[- 1 ] + 6[0] - (5[—3] = 1 y[ 3] = y[ 2 ] + 6[3] - <5[0] = 1-1 = 0 

y[ 1] = 2/[0] + S[l] - S[-2] = 1 y[ 4 ] = y[3] + 5[4] - 6[1] = 0 

y[ 2] = y[ 1 ] + S[2] - 5 [— 1 ] = 1 y[ 5 ] = y[ 4 ] + 5 [ 5 ) - 5[2] = 0 

The impulse response of this “recursive” filter is zero after the first three values and has a finite length. 
It is actually a nonrecursive (FIR) filter in disguise! 


DRILL PROBLEM 3.8 

(a) Let y[n] — y[n — 1] — 2 y[n — 2] = u[n]. Use recursion to compute j/[3] if y[— 1] = 2, y[— 2] = 0. 

(b) Let y[n] — 0.8y[n— 1] = x[n}. Use recursion to find the general form of y[n] if x[n\ = <5[n] and y\— 1] = 0. 

Answers: (a) 32 (b) (0.8) n , n > 0 or (0.8) n ii[n] 


3.4 The Natural and Forced Response 

For an LTI system governed by a linear constant-coefficient difference equation, a formal way of computing 
the output is by the method of undetermined coefficients. This method yields the total response y[n] as 
the sum of the forced response yp [n] and the natural response [n] ■ The form of the natural response 
depends only on the system details and is independent of the nature of the input. The forced response arises 
due to the interaction of the system with the input and thus depends on both the input and the system 
details. 

3.4.1 The Single-Input Case 

Consider the Ath-order difference equation with the single unsealed input x [n] 

y[n] + Aiy[n - 1] + A 2 y[n - 2] -I-1- A N y[n - N] = x[n\ (3-14) 

with initial conditions y[— 1], y[— 2], y{— 3],..., y{— A]. 

Its forced response arises due to the interaction of the system with the input and thus depends on 
both the input and the system details. It satisfies the given difference equation and has the same form as the 
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input. Table 3.1 summarizes these forms for various types of inputs. The constants in the forced response 
can be found uniquely and independently of the natural response or initial conditions simply by satisfying 
the given differential equation. 

The characteristic equation is defined by the polynomial equation 

1 + A i ^" 1 + + • • • + A n z~ n =z N + A lZ N ~ 1 + • • • + A n = 0 (3.15) 

This equation has N roots, Zi, z 2 ,■■■, z^. The natural response is a linear combination of N discrete-time 
exponentials of the form 


Vi vfa] — + K2Z2 + • • • + KnZn 


(3.16) 


This form must be modified for multiple roots. Since complex roots occur in conjugate pairs, their associated 
constants also form conjugate pairs to ensure that y,y [«] is real. Algebraic details lead to the preferred form 
with two real constants. Table 3.2 summarizes the preferred forms for multiple or complex roots. 

The total response is found by first adding the forced and natural response and then evaluating the un¬ 
determined constants (in the natural component) using the prescribed initial conditions. For stable systems, 
the natural response is also called the transient response, since it decays to zero with time. For systems 
with harmonic or switched harmonic inputs, the forced response is a harmonic at the input frequency and 
is termed the steady-state response. 


Table 3.1 Form of the Forced Response for Discrete LTI Systems 


Note: If the right-hand side (RHS) is a n , where a is also a root of the characteristic 
equation repeated p times, the forced response form must be multiplied by n p . 

Entry 

Forcing Function (RHS) 

Form of Forced Response 

1 

Cq (constant) 

C\ (another constant) 

2 

a n (see note above) 

Ca n 

3 

cos(nfi + (3) 

C\ cos(nfl) + C 2 sin(nfl) or C cos(nfl + 4>) 

4 

a n cos(nfl + (3) (see note above) 

a" [Ci cos(nfl) + C 2 sin(nfl)] 

5 

n 

Cq + Cm 

6 

nP 

Cq + Ci Tl + C 2 TI 2 + • • • + CpllP 

7 

na n (see note above) 

cC( Cq + Cm) 

8 

nPa n (see note above) 

a n (C 0 + C\n + C 2 n 2 + • • • + C p n p ) 

9 

ncos(nfl + (3) 

(Ci + C 2 n)cos(nfl) + (C 3 + C 4 n)sin(nfl) 
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Table 3.2 Form of the Natural Response for Discrete LTI Systems 


Entry 

Root of Characteristic Equation 

Form of Natural Response 

1 

Real and distinct: r 

I\r n 

2 

Complex conjugate: re jn 

r n [K\ cos(nfl) + K 2 sin(nfl)] 

3 

Real, repeated: r p+1 

r™(AT 0 + Kyn + K 2 n 2 + ■ ■ ■ + K p n p ) 

4 

Complex, repeated: (re ja ) P+1 

r™ cos(nfl)(A 0 + Ain + A 2 n 2 + • • • + A p n p ) 

+ r™ sin(nf2)(.Bo + Bin + B 2 n 2 + • • • + B p n p ) 


REVIEW PANEL 3.6 

Response of LTI Systems Described by Difference Equations 
Total Response = Natural Response + Forced Response 

The roots of the characteristic equation determine only the form of the natural response. 
The input terms (RHS) of the difference equation completely determine the forced response. 
Initial conditions satisfy the total response to yield the constants in the natural response. 


EXAMPLE 3.7 (Forced and Natural Response) 

(a) Consider the system shown in Figure E3.7A. 

Find its response if x[n\ = (0.4)™, n > 0 and the initial condition is y[— 1] = 10. 



Figure E3.7A The system for Example 3.7(a) 

The difference equation describing this system is y[n] — 0.6y[n — 1] = x[ri\ = (0.4)™, n > 0. 
Its characteristic equation is 1 — 0 . 62“ 1 = 0or 2 — 0.6 = 0. 

Its root z = 0.6 gives the form of the natural response j/jv[n] = AT(0.6)™. 

Since x[n] = (0.4)™, the forced response is y F [n] = C(0.4)™. 

We find C by substituting for y F [n\ into the difference equation 
y F [n] - 0.6 y F [n - 1] = (0.4)™ = C(0.4)™ - t)£C{0A) n ~ l . 

Cancel out (0.4)™ from both sides and solve for C to get 
C — 1.5(7 = 1 or C = - 2 . 

Thus, y F [n] = —2(0.4)™. The total response is y[n] = yN[n] + y F [n\ = —2(0.4)™ + A"(0.6)™. 
We use the initial condition y[— 1] = 10 on the total response to find K : 
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y\- 1] = 10 = -5 + ^ and K = 9. 
Thus, y[n] = -2(0.4)" + 9(0.6)", n > 0. 


(b) Consider the difference equation y[n] — 0.5 y[n — 1] = 5cos(0.5wr), n > 0 with y[— 1] = 4. 

Its characteristic equation is 1 — 0.5z -1 = 0 or 2 — 0.5 = 0. 

Its root z = 0.5 gives the form of the natural response ?/jv[n] = K{ 0.5)". 

Since x[n] = 5 cos( 0 . 5 n 7 r), the forced response is yp[n] = Acos( 0 . 5 ?r 7 r) + B sin( 0 . 5 n 7 r). 

We find yp[n — 1] = Acos[0.5(n — l) 7 r] + i?sin[0.5(n — l) 7 r] = Asin( 0 . 5 n 7 r) — Rcos( 0 . 5 n 7 r). Then 
yF[n\ ~ 0.5 yp[n — 1] = (A + 0 . 5 I?)cos( 0 . 5 ?i 7 r) — (0.5A — B)sin( 0 . 5 n 7 r) = 5 cos( 0 . 5 ?r 7 r) 
Equate the coefficients of the cosine and sine terms to get 

(.A + 0.5 B) = 5, (0.5A — B) = 0 or A = 4, B = 2, and g/p^n] = 4 cos( 0 . 5 n 7 r) + 2 sin( 0 . 5 n 7 r). 

The total response is y[n] = A'(0.5)" + 4 cos( 0 . 5 n 7 r) + 2 sin( 0 . 5 n 7 r). With y[—1] = 4, we find 
y[— 1] = 4 = 2 K — 2 or K = 3, and thus y[n] = 3(0.5)" + 4 cos( 0 . 5 n 7 r) + 2 sin( 0 . 5 ?r 7 r), n > 0. 

The steady-state response is 4 cos( 0 . 5 n 7 r) + 2 sin( 0 . 5 n 7 r), and the transient response is 3(0.5)". 


(c) Consider the difference equation y[n] — 0.5 y[n — 1] = 3(0.5)", n > 0 with y[— 1] = 2. 

Its characteristic equation is 1 — 0.52 -1 = 0 or 2 — 0.5 = 0. 

Its root, 2 = 0.5, gives the form of the natural response 2 Mr[?z] = AT(0.5)". 

Since x\n\ = (0.5)" has the same form as the natural response, the forced response is f/F[n] = Cn(0.5)". 
We find C by substituting for yp[n] into the difference equation: 
y F [n) - 0.5 y F [n - 1] = 3(0.5)" = Cn{ 0.5)" - 0.5C(n - 1)(0.5)"- 1 . 

Cancel out (0.5)" from both sides and solve for C to get Cn — C(n — 1) = 3, or C = 3. 

Thus, j/fM = 3n(0.5)". The total response is y[n] = yN[n} + yF[n] = K{ 0.5)" + 3?i(0.5)". 

We use the initial condition y[— 1] = 2 on the total response to find K: 
y[- 1] = 2 = 2K — 6, and K = 4. 

Thus, y[n\ = 4(0.5)" + 3n(0.5)" = (4 + 3n)(0.5)", n > 0. 


(d) (A Second-Order System) Consider the system shown in Figure E3.7D. 

Find the forced and natural response of this system if x[n ] = u[n] and y[— 1] = 0, y[— 2] = 12. 



Figure E3.7D The system for Example 3.7(d) 
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Comparison with the generic realization reveals that the system difference equation is 

y[n] - \y[n - 1 ] - \y[n - 2 ] = 4 x[n\ = 4 u[n\ 

Its characteristic equation is 1 — \z~ x — \z~ 2 = 0 or z 2 - ^ | = 0. 

Its roots are z\ = \ and z 2 = — 

The natural response is thus j/Ar[n] = Ki(zi) n + A 2 (z 2 )” = -Ki(§)™ + AT 2 (— |)™. 

Since the forcing function is 4w[n] (a constant for n > 0), the forced response yF[n\ is constant. 

Let = C. Then yp[n — 1] = C, yF[n — 2] = C, and 

VF[n] - \yF[n - 1] - \yF[n - 2] = C - \C - \C = 4. This yields C = 6 . 

Thus, j/fM = 6 . The total response y[n) is y[n] = j/Ar[n] + 2 /f[«] = Ki{\) n + AT 2 (— + 6 . 

To find the constants K\ and i\ 2 , we use the initial conditions on the total response to obtain 
y[- 1] = 0 = 2ATi - 3/v 2 + 6, and y[- 2] = 12 = 4A, + 9A 2 + 6. We find A'i = -1.2 and A 2 = 1.2. 
Thus, y[n\ = -1.2(|) n + 1.2(-|) n + 6, n > 0. 

Its transient response is —1.2(i) n + 1.2(—|) n . Its steady-state response is a constant that equals 6 . 


DRILL PROBLEM 3.9 | 

(a) Let y[n] — 0.8y[n — 1] = 2 with y[— 1] = 5. Solve for y[n], n > 0. 

(b) Let y[n] + 0.8y[n — 1] = 2(0.8)” with y[— 1] = 10. Solve for y[n], n > 0. 

(c) Let y[n] — 0.8y[?r — 1] = 2(0.8)™ with y[— 1] = 5. Solve for y[n], n > 0. 

(d) Let y[n] — 0.8y[n — 1] = 2(—0.8)™ + 2(0.4)™ with y[— 1] = —5. Solve for y[n], n> 0. 

Answers: (a) 10-4(0.8)™ (b) (0.8)™ - 7(-0.8)™ (c) (2n + 6)(0.8)™ (d) (0.8)™ + (-0.8)™ - 2(0.4)” 


3.4.2 The Zero-Input Response and Zero-State Response 

A linear system is one for which superposition applies and implies that the system is relaxed (with zero initial 
conditions) and that the system equation involves only linear operators. However, we can use superposition 
even for a system with nonzero initial conditions that is otherwise linear. We treat it as a multiple-input 
system by including the initial conditions as additional inputs. The output then equals the superposition 
of the outputs due to each input acting alone, and any changes in the input are related linearly to changes 
in the response. As a result, its response can be written as the sum of a zero-input response (due to the 
initial conditions alone) and the zero-state response (due to the input alone). The zero-input response obeys 
superposition, as does the zero-state response. 

It is often more convenient to describe the response y[n\ of an LTI system as the sum of its zero-state 
response (ZSR) y zs [n] (assuming zero initial conditions) and zero-input response (ZIR) y z i[n\ (assuming zero 
input). Each component is found using the method of undetermined coefficients. Note that the natural and 
forced components j/Ar[n] and j/fM do not, in general, correspond to the zero-input and zero-state response, 
respectively, even though each pair adds up to the total response. 
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REVIEW PANEL 3.7 

The ZSR and ZIR for y[n] + A-\ y[n — 1] + • • • + Apiy[n — TV] = x[n] 

1. Find ZSR from y zs [n\ + Aiy zs [n — 1] + • • • + A^y zs [n — N] = x[n ], assume zero initial conditions. 

2. Find ZIR from y z \ [n] + Aiy z ][n — 1] + • • • + AMy z i[n — IV] = 0, using given initial conditions. 

3. Find complete response as y[n ] = y zs [n] + y z i[n\. 

The ZSR obeys superposition. The ZIR obeys superposition. 


EXAMPLE 3.8 (Zero-Input and Zero-State Response for the Single-Input Case) 

(a) (A First-Order System) Consider the difference equation y[n\ — 0.6 y[n — 1] = (0.4)”, n > 0, with 

y[- 1] = io. 

Its characteristic equation is 1 — 0.6z -1 = 0 or 2 — 0.6 = 0. 

Its root z = 0.6 gives the form of the natural response jjv[n] = K( 0.6)". 

Since x\n] = (0.4)”, the forced response is «/j?[n] = C(0.4)”. 

We find C by substituting for y F [n] into the difference equation 
y F [n] - 0.6 y F [n - 1] = (0.4)” = C(0.4)” - 0.6C(0.4)"- 1 . 

Cancel out (0.4)" from both sides and solve for C to get 
C- 1.5(7 = 1 or C = - 2 . 

Thus, y F [n] = -2(0.4)”. 

The total response (subject to initial conditions) is y[n] = y F [n ] + ?/jv[n] = —2(0.4)” + A"(0.6)" 

1. Its ZSR is found from the form of the total response is y zs [n] = —2(0.4)” + AT(0.6)”, assuming 
zero initial conditions: 

3/zb[— 1] = 0 = -5 + ^ K = 3 y zs [n] = -2(0.4)” + 3(0.6)”, n > 0 

2. Its ZIR is found from the natural response y z i[n\ = R'(0.6)”, with given initial conditions: 

3/zi[— 1] = 10 = £ K = 6 y zi [n] = 6(0.6)”, n > 0 

3. The total response is y[n] = y z i[n\ + y zs [n\ = —2(0.4)” + 9(0.6)”, n > 0. 


(b) (A Second-Order System) 

Let y[n] — \y\n — 1] — \y[n — 2] = 4, n > 0, with y[— 1] = 0 and y[— 2] = 12. 

Its characteristic equation is 1 — ^ 2 _1 — \z~‘ 1 = 0 or z 2 — \z — | = 0. 

Its roots are z\ = \ and z 2 = — |. 

Since the forcing function is a constant for n > 0, the forced response y F [n\ is constant. 

Let y F [n] = C. Theny F [n-l\ = C,y F [n- 2] = C, sm&y F [n]-\y F [n-l}-\y F [n-2] = C-\C-\C = 4. 
This yields C = 6 to give the forced response y F [n\ = 6. 
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1. The ZIR has the form of the natural response y z i[n\ = K\{\) n + AT 2 (—|)". 

To find the constants, we use the given initial conditions y[— 1] = 0 and y[— 2] = 12: 

0 = Ad(i )" 1 + A^(-i )- 1 = 2 K\ - 3AT 2 12 = A ^)" 2 + K 2 (-±)- 2 = 4A", + 9 K 2 
Thus, K\ = 1.2, K 2 = 0.8, and 

y zi [n] = 1 . 2 (|)" + 0 . 8 (-§)", n >0 

2. The ZSR has the same form as the total response. Since the forced response is y^[n] = 6 , we have 

y zs [n] = Ki(l) n + K 2 (~l) n + 6 

To find the constants, we assume zero initial conditions, y[— 1] = 0 and y[— 2] = 0, to get 
y[- 1] = 0 = 2ATi - 3K 2 + 6 y[- 2] = 0 = 4A', + 9K 2 + 6 

We find R\ = —2.4 and K = 0.4, and thus 

yzs[n\ = —2.4(A) 11 _|_ 0.4(—|)" + 6, n>0 

3. The total response is y[n] = y z i[n\ + y zs [n\ = —1.2(g)" + 1.2(— |)" + 6 , n > 0. 


(c) (Linearity and Superposition of the ZSR and ZIR) An HR filter is described by y[n ] — y[n — 

1] — 2 y[n — 2] = x[n], with x[n] = 6 u[n] and initial conditions y[— 1] = —1, y[— 2] = 4. 

1. Find the zero-input response, zero-state response, and total response. 

2. How does the total response change if y[— 1] = —1, y[— 2] = 4 as given, but x[n\ = 12u[n]? 

3. How does the total response change if x[n ] = 6 w[n] as given, but y[— 1] = —2, y[— 2] = 8 ? 

1. We find the characteristic equation as (1 — z -1 — 2^ -2 ) = 0 or (z 2 — z — 2) = 0. 

The roots of the characteristic equation are Zi = — 1 and z 2 = 2. 

The form of the natural response is yN[n] = A(—1)" + B( 2)". 

Since the input x[n] is constant for > 0, the form of the forced response is also constant. 

So, choose ypln] = C in the system equation and evaluate C: 

yi?[n] — yp[n — 1] — 2yp[n — 2] = C — C — 2 C = 6 C = —3 yp[n] = —3 

For the ZSR, we use the form of the total response and zero initial conditions: 

Vzs[n\ = yF[n\ + ywin] = -3 + A(- 1)" + B{ 2)", y[- 1] = y\- 2] = 0 

We obtain y zs [— 1] = 0 = — 3 — A + 0.5 B and y zs [— 2] = 0 = — 3 + A + 0.25 B 
Thus, A = 1, B = 8 , and y zs [n] = — 3 + (—1)" + 8(2)", n > 0. 

For the ZIR, we use the form of the natural response and the given initial conditions: 
s/zi M = VN[n] = A(- 1)" + B{ 2)" y[- 1] = -1 y[- 2] = 4 

This gives y z \[— 1] = —1 = —A + 0.5R, and y z i[—2] = 4 = A + 0.25 B. 

Thus, A = 3, B = 4, and y zi [n] = 3(-l)" + 4(2)", n > 0. 

The total response is the sum of the zero-input and zero-state response: 

v[n\ = y zi [n] + y zs [n } = -3 + 4(-l)" + 12(2)", n > 0 

2. If x[n\ = 12w[n], the zero-state response doubles to y zs [n\ = —6 + 2(—1)" + 16(2)". 

3. If ?/[— 1] = —2 and y[— 2] = 8 , the zero-input response doubles to y z i[n] = 6 (—1)" + 8(2)". 
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DRILL PROBLEM 3.10 

(a) Let y[n] — 0.8 y[n — 1] = 2. Find its zero-state response. 

(b) Let y[n] + 0.8y[n — 1] = x[n) with y[— 1] = —5. Find its zero-input response. 

(c) Let y[n} — 0.4y[n — 1] = (0.8)” with y[— 1] = 10. Find its zero-state and zero-input response. 

Answers: (a) 10 - 8(0.8)” (b) 4(-0.8)” (c) 2(0.8)” - (0.4)”, 4(0.4)” 

3.4.3 Solution of the General Difference Equation 

The solution of the general difference equation described by 

y[n] + Aiy[n — 1] + • • • + A^yln — N] = Box[n] + B\x[n — 1] + • • • + Bmx[ti — M] (3-17) 
is found by invoking linearity and superposition as follows: 

1. Compute the zero-state response yo[n\ of the single-input system 

2/oM + Aiy 0 [n - 1] + A 2 y 0 [n - 2] -I-1- A N y 0 [n — N] = x[n] (3.18) 

2. Use linearity and superposition to find y zs [n] as 

y zs [n\ = B 0 y 0 [n] + Ri 2 /o[n - 1] 4-h B M ya[n - M] (3.19) 

3. Find the zero-input response y 7 \ [n] using initial conditions. 

4. Find the total response as y[n\ = y zs [n ] + y zl [n]. 

Note that the zero-input response is computed and included just once. 


REVIEW PANEL 3.8 

Solving y[n] + Aiy[n — 1] + • • • + A^yln — N] = Bqx[ti\ + Bix[n — 1] + • • • + Bmx[u — M] 

1. Find yo[n} from yo[n} + Ai?/o[n — 1] + • • • + AMyo[n — N] = x[n\ , assume zero initial conditions. 

2. Find ZSR (using superposition) as y zs [n ] = B 0 y 0 [n] + Biy 0 [n — 1] + • • • + B M y 0 [n — M], 

3. Find ZIR from y 7j \ [n] + .4 1 y 7 \ [n — 1] + • • • + .4 ,v y 7A [n — N] - 0. using given initial conditions. 

4 . Find complete response as y[n] = y zs [n] + y z i[n}. 


EXAMPLE 3.9 (Response of a General System) 

Consider the recursive digital filter whose realization is shown in Figure E3.9. 
What is the response of this system if x[n\ = 6 u[n\ and ?/[— 1] = —1, y{— 2] = 4? 
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Comparison with the generic realization reveals that the system difference equation is 

y[n\ — y[n — 1] — 2 y[n — 2] = 2x[n] — x[n — 1] 

From the previous example, the ZSR of y[n] — y[n— 1] — 2y[n— 2] = x[n\ is yo[n] = [—3+(—l)” + 8(2)”]'it[n]. 
The ZSR for the input 2 x[n] — x[n — 1] is thus 

y»[n] = 2 2 / 0 [n] - y 0 [n - 1] = [-6 + 2(-l)" + 16(2)"]u[n] - [3 + (—1)” _1 + 8(2) n - 1 ]u[n - 1] 

From the previous example, the ZIR of y[n] — y[n — 1] — 2 y[n — 2] = x[n] is y z i[n\ = [3(—1)” + 4(2 ) n ]u[n\. 
The total response is y[n] = y z i[n] + 2 / zs [n]: 

y[n} = [3(—1)” + 4(2)”]u[n] + [-6 + 2(-l)" + 16(2)”]u[n] - [3 + (-l) 11 " 1 + 8(2) n ~ 1 ]u[n - 1] 


DRILL PROBLEM 3.11 

(a) Let y[n] — 0.8y[n — 1] = x[n] with x[n] = 2(0.4)” and y[— 1] = —10. Find its ZSR and ZIR. 

(b) Let y[n] — 0.8 y[n — 1] = 2 x[n] with x[n] = 2(0.4) n and y[—1] = —10. Find y[n\. 

(c) Let y[n] — 0.8y[n — 1] = 2 x[n\ — x[n — 1] with x[n] = 2(0.4)” and j/[—1] = —10. Find y[n]. 

Answers: (a) 4(0.8)” - 2(0.4)”, -8(0.8)” (b) -4(0.4)” (c) (0.4)” - 5(0.8)” (simplified) 


3.5 The Impulse Response 

The impulse response h{n\ of a relaxed LTI system is simply the response to a unit impulse input 5[n]. The 
impulse response provides us with a powerful method for finding the zero-state response of LTI systems to 
arbitrary inputs using superposition (as described in the next chapter). The impulse response and the step 
response are often used to assess the time-domain performance of digital filters. 


REVIEW PANEL 3.9 


The Impulse Response and Step Response Is Defined Only for Relaxed LTI Systems 


Impulse input S [n\ - 


Relaxed LTI system 


Impulse response h [n\ 


Impulse response h[n\: The output of a relaxed LTI system if the input is a unit impulse S[n] 
Step response s[n]: The output of a relaxed LTI system if the input is a unit step u [n] 


3.5.1 Impulse Response of Nonrecursive Filters 

For a nonrecursive (FIR) filter of length M + 1 described by 

y[n] = Box[n] + B\x[n — 1] + • • • + Bmx[ti — M\ (3.20) 

the impulse response h[n] (with x[n\ = <5[n]) is an M + 1 term sequence of the input terms, which may be 
written as 

4 

h[n\ = B 0 5[n\ + Bi6[n — 1} + ■ ■ ■ + BmS[h — M] or h[n\ = {B 0 , B\, ..., Bm} (3-21) 

The sequence h[n) represents the FIR filter coefficients. 
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DRILL PROBLEM 3.12 

(a) Let y[n] = 2 x[n + 1] + 3x[?r] — x[n — 2], Write its impulse response as a sequence. 

(b) Let y[n] = x[n] — 2 x[n — 1] + Ax[n — 3]. Write its impulse response as a sum of impulses. 

Answers: (a) h[n\ = {2, 3, 0, —1} (b) h[n ] = <f[n] — 2 S[n — 1] + 4 S[n — 3] 


3.5.2 Impulse Response by Recursion 

Recursion provides a simple means of obtaining as many terms of the impulse response h[n] of a relaxed 
recursive filter as we please, though we may not always be able to discern a closed form from the results. 
Remember that we must use zero initial conditions. 


EXAMPLE 3.10 (Impulse Response by Recursion) 

Find the impulse response of the system described by y[n\ — ay[n — 1] = x[n}. 

We find h[n] as the solution to h[n] = ah[n — 1] + 5[?r] subject to the initial condition y{— 1] = 0. By 
recursion, we obtain 

ft.[0] = ah[— 1] + <5[0] = 1 h[ 2] = ah[ 1] = a 2 
= a/i[0] = a ft.[3] = ah[ 2] = a 3 

The general form of h[n ] is easy to discern as h[n] = a n u[n\. 


DRILL PROBLEM 3.13 

(a) Let y[n\ + 0.8y[n — 1] = x[n]. Find its impulse response by recursion. 

(b) Let y [n] + 0.8 y[n — 1] = 3x[n]. Find its impulse response by recursion, 

(c) Let y[n\ — ay[n — 1] = Cx[n\. Find its impulse response by recursion. 

Answers: (a) (—0.8)" (b) 3(—0.8)" (c) Ca n 


3.5.3 Impulse Response for the Single-Input Case 

Consider the Ath-order difference equation with a single input: 

y[n\ + Ary[n — 1] + A 2 y[n — 2] + • • • + A N y[n — N] = x[n ] (3.22) 

To find its impulse response, we solve the difference equation 

h[n\ + Aih[n — 1] + A 2 h[n — 2] + • • • + Ajyh[n — N] = <5[n] (zero initial conditions) (3.23) 

Since the input <f[n] is zero for n > 0, we must apparently assume a forced response that is zero and thus 
solve for the natural response using initial conditions (leading to a trivial result). The trick is to use at 
least one nonzero initial condition, which we must find by recursion. By recursion, we find ft,[0] = 1. Since 
S [rt] = 0, n > 0, the impulse response is found as the natural response of the homogeneous equation 

h\n] + A 1 h[n — 1] + A 2 h[n — 2] + • • • + A N h[n — N] = 0, ft[0] = 1 (3.24) 

subject to the nonzero initial condition /i[0] = 1. All the other initial conditions are assumed to be zero 
(h[— 1] = 0 for a second-order system, h[— 1] = h[— 2] = 0 for a third-order system, and so on). 
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REVIEW PANEL 3.10 

The Impulse Response of y[n] + A\y[n — 1] + • • • + A]yy[n — TV] = x[n] 

Find h[n] from h[n ] + Aih[n — 1] + • • • + A^h[n — V] = 0, with just /i[0] = 1 (all others zero). 


EXAMPLE 3.11 (Impulse Response Computation for the Single-Input Case) 

(a) (A First-Order System) Consider the difference equation y[n\ — 0.6 y[n — 1] = x[n]. 
Its impulse response is found by solving h[n ] — 0.6 h[n — 1] = 0, /i[0] = 1. 

Its natural response is h[n] = K( 0.6) n . 

With h[0] = 1, we find K = 1, and thus h[n\ = (0.6)™w[n]. 


(b) (A Second-Order System) Let y[n] — \y[n — 1] — \y[n — 2] = x[n\. 

Its impulse response is found by solving h[n] — \h[n — 1] — \h[n — 2] = 0, h[ 0] = 1, h[— 1] = 0. 
Its characteristic equation is 1 — |z _1 — §~ -2 = 0 or z 2 — \z — | = 0. 

Its roots, z\ = \ and z-i = —give the natural response h[n] = Ki(\) n + K 2 (— |) n . 

With h[0] = 1 and h[— 1] = 0, we find 1 = K\ +1\ 2 and 0 = 2K\ — 3K 2 . 

Solving for the constants, we obtain Ki = 0.6 and K 2 = 0.4. 

Thus, h[n] = [0.6(|) n + 0.4(— |) n ]u[n]. 


DRILL PROBLEM 3.14 | 

(a) Let y[n\ — 0.9y[n — 1] = x[n]. Find its impulse response h[n]. 

(b) Let y[n] — 1.2 y[n — 1] + 0.32y[n — 2] = x[n\. Find its impulse response h[n}. 

Answers: (a) (0.9) n (b) 2(0.8) ra - (0.4)™ 

3.5.4 Impulse Response for the General Case 

To find the impulse response of the general system described by 

y[n] + Aiy[n — 1] + A 2 y[n — 2] + • • • + A]yy[n — N] = Box[n] + Bix[n — 1] + • • • + Bmx[u — M] (3.25) 
we use linearity and superposition as follows: 

1. Find the impulse response ho[n\ of the single-input system 

2 / 0 M + 4ij/ 0 [« - 1] + A 2 y 0 [n - 2] H--1- A N y 0 [n — N] = x[n] (3.26) 

by solving the homogeneous equation 

ho[n] + Aiho[n — 1] + • • • + A]yho[n — N] = 0, /io[0] = 1 (all other conditions zero) (3.27) 

2. Then, invoke superposition to find the actual impulse response h[n] as 

h.[n) = B 0 h 0 [n\ + Bih 0 [n — 1] + • • • + B M h 0 [n — M] (3.28) 
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Impulse Response of y[n\ + Aiy[n - 

1. Find ho[n\ from ho[n] + Aiho[n — 1 

2. Find h[n] (using superposition) as * 

REVIEW PANEL 3.11 

- 1] H -1- A N y[n - N] = B 0 

] + ••• + A^h 0 [n -JV] = 0w 
h[n] = B 0 h 0 [n] + Bih 0 [n - 1] 

x[n] + B\x[n — 1] + • • • + Bmx[h — M] 
ith just h 0 [ 0] = 1 ( all others zero). 

+ • • • + BMho\n — M ]. 


EXAMPLE 3.12 (Impulse Response for the General Case) 

(a) Find the impulse response of y[n] — 0.6 y[n — 1] = 4 x[n] and y[n] — 0.6 y[n — 1] = 3 x[n + 1] — x[n}. 
We start with the single-input system yo[n] — 0.6yo[n — 1] = x[n]. 

Its impulse response ho[n\ was found in the previous example as ho[n] = (0.6)"w[n]. 

Then, for the hrst system, h\n\ = Ah 0 [n] = 4(0.6)"u[n]. 

For the second system, h[n} = 3h 0 [n + 1] — ho[n] = 3(0.6)" +1 w[n + 1] — (0.6)"u[n]. 

This may also be expressed as h[n] = 35[?r + 1] + 0.8(0.6)"u[?r]. 

Comment: The general approach can be used for causal or noncausal systems. 


(b) Let y[n\ - \y[n - 1] - \y[n - 2] = 2 x[n\ - 6 x[n - 1]. 

To find h[n], start with the single-input system y[n] — ^y[n — 1] — \y[n — 2] = x[n\. 
Its impulse response hv[n] was found in the previous example as 

h 0 [n] = [0.6(|) n + 0.4(-i) n ]u[n] 

The impulse response of the given system is h[n] = 2/i 0 [?r] — 6h 0 [n — 1]. This gives 
h[n] = [1.2(|)" + 0.8(-|)"]u[n] - ^^(i)"- 1 + 2A(-\) n ~ 1 ]u[n - 1] 

Comment: This may be simplified to h[n} = [— 6(|) n + 8(— |)"]u[n]. 


DRILL PROBLEM 3.15 

(a) Let y[n] — 0.5 y[n — 1] = 2 x[n\ + x[n — 1]. Find its impulse response h[n]. 

(b) Let y[n] — 1.2 y[n — 1] + 0.32y[n — 2] = x [n] + 2 x[n — 1]. Find its impulse response h[n ]. 

Answers: (a) 2(0.5)”u[n] + (0.5)" _1 u[n — 1] = 4(0.5)"u[?r] — 25{n] (b) 7(0.8)" — 6(0.4)" (simplified) 


3.5.5 Recursive Forms for Nonrecursive Digital Filters 

The terms FIR and nonrecursive are synonymous. A nonrecursive filter always has a finite impulse response. 
The terms HR and recursive are often, but not always, synonymous. Not all recursive filters have an infinite 
impulse response. In fact, nonrecursive filters can always be implemented in recursive form if desired. A 
recursive filter may also be approximated by a nonrecursive filter of the form y[n] = Box[n] + Bix[n — 1 ] + 
• • • + Bmx[it, — M] if we know all the past inputs. In general, this implies M —> oo. 
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EXAMPLE 3.13 (Recursive Forms for Nonrecursive Filters) 

Consider the nonrecursive filter y[n] = x[n] + x[n — 1] + x[n — 2]. 

Its impulse response is h[n] = <5[n] + <f[?r — l] + 8[n — 2\. 

To cast this filter in recursive form, we compute y[n — 1] = x[n — 1] + x[n — 2] + x[n — 3]. 
Upon subtraction from the original equation, we obtain the recursive form 

■y[n\ — y[n — 1] = x[n\ — x[n — 3] 

This describes a recursive formulation for the given nonrecursive, FIR filter. 


DRILL PROBLEM 3.16 | 

Consider the nonrecursive filter y[n] = x[n\ + x[n — 1] + x[n — 2]. What recursive filter do you obtain by 
computing y[n] — y[n — 2\. Does the impulse response of the recursive filter match the impulse response of 
the nonrecursive filter? 

Answers: y[n] — y[n — 2] = x[n] + x[n — 1] — x[n — 3] — x[n — 4], the impulse responses match. 


3.5.6 The Response of Anti-Causal Systems 

So far, we have focused on the response of systems described by difference equations to causal inputs. 
However, by specifying an anti-causal input and appropriate initial conditions, the same difference equation 
can be solved backward in time for n < 0 to generate an anti-causal response. For example, to find the 
causal impulse response h[n], we assume that h[n\ =0, n < 0; but to find the anti-causal impulse response 
hA[n) of the same system, we would assume that h[n] = 0, n > 0. This means that the same system can be 
described by two different impulse response functions. How we distinguish between them is easily handled 
using the ^-transform (described in the next chapter). 


EXAMPLE 3.14 (Causal and Anti-Causal Impulse Response) 

(a) Find the causal impulse response of the first-order system y[n] — QAy[n — 1] = x[n}. 

For the causal impulse response, we assume h[n\ =0, n < 0, and solve for h[n\, n > 0, by recursion 
from h[n] = 0Ah[n — 1] + 5[n]. With h[ 0] = 0.4h[—1] + 6[0] = 1 and <5[n] =0, n / 0, we find 

h[ 1] = 0.4/i[0] = 0.4 h[ 2] = 0.4/i[l] = (0.4) 2 h[ 3] = 0Ah[2] = (0.4) 3 etc. 

The general form is easily discerned as h[n\ = (0.4) n and is valid for n > 0. 

Comment: The causal impulse response of y[n] — ay[n — 1] = x[n\ is h[n\ = a n u[n]. 


(b) Find the anti-causal impulse response of the first-order system y[n] — 0Ay[n — 1] = x[n\. 

For the anti-causal impulse response, we assume h[n] =0, n > 0, and solve for h[n], n < 0, by recursion 
from h[n — 1] = 2.5(h[n\ — 5[n]). With h[— 1] = 2.5(/i[0] — <5[0]) = —2.5, and <5[n] =0, n yf 0, we find 

h[—2] = 2.5/i[—1] = —(2.5) 2 ft [—3] = 2.5ft[—2] = —(2.5) 3 ft [-4] = 2.5ft[-3] = -(2.5) 4 etc. 
The general form is easily discerned as h[n\ = — (2.5) -n = —(0.4)” and is valid for n < —1. 
Comment: The anti-causal impulse response of y[n\ — ay[n — 1] = x[n] is h[n] = —a n u[—n — 1], 
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DRILL PROBLEM 3.17 


Let y[n ] — 0.5 y[n — 1] = 2 x[n]. 
Answers: h c [n\ = 2(0.5)"w[n] 

Find its causal impulse response and anti-causal impulse response. 

, h ac [n] = -2(0.5 ) n u[-n - 1] 


3.6 System Representation in Various Forms 

An LTI system may be described by a difference equation, impulse response, or input-output data. All three 
are related and, given one form, we should be able to access the others. We have already studied how to 
obtain the impulse response from a difference equation. Here we shall describe how to obtain the system 
difference equation from its impulse response or from input-output data. 

3.6.1 Difference Equations from the Impulse Response 

In the time domain, the process of finding the difference equation from its impulse response is tedious. It is 
much easier implemented by other methods (such as the ^-transform). The central idea is that the terms in 
the impulse response are an indication of the natural response (and the roots of the characteristic equation) 
from which the difference equation may be reconstructed if we can describe the combination of the impulse 
response and its delayed versions by a sum of impulses. The process is best illustrated by some examples. 


EXAMPLE 3.15 (Difference Equations from the Impulse Response) 

(a) Let h[n] = u[n]. Then h[n — 1] = u[n — 1], and h[n] — h[n — 1] = u[n] — u[n — 1] = 5[n]. 

The difference equation corresponding to h[n) — h[n — 1] = 5[n] is simply y[n] — y[n — 1] = x[n]. 


(b) Let h[n] = 3(0.6)"u[n]. This suggests a difference equation whose left-hand side is y[n\ — 0.6 y[n — 1]. 
We then set up h[n] — 0.6 h[n — 1] = 3(0.6)”u[n] — 1.8(0.6)" -1 u[n — 1]. This simplifies to 
h[n] — 0.6 h[n — 1] = 3(0.6)"u[n] — 3(0.6) n u[n — 1] = 3(0.6) n («[n] — u[n — 1]) = 3(0.6)”5[n] = 35[n] 
The difference equation corresponding to h[n\ — 0.6ft [n — 1] = 3<5[n] is y[n ] — 0.6 y[n — 1] = 3x[n]. 


(c) Let h[n] = 2(—0.5)”u[n] + (0.5) n w[?r]. This suggests a characteristic equation (z — 0.5 )(z + 0.5). 

The left-hand side of the difference equation is thus y[n] — 0.25 y[n — 2], We now compute 

h[n] - 0.25ft[n - 2] = 2(-0.5)"w[n] + (0.5) n u[n] - 0.25(2(-0.5)"- 1 u[n - 1] + (O.S)”- 1 ^^ - 1]) 
This simplifies to 

h[n] - 0.25ft[n - 2] = [2(-0.5) n + (0.5) n ](u[n] - u[n - 2]) 

Since u[n] — u[n — 2] has just two samples (at n = 0 and n = 1), it equals <5[n] + S[n — 1], and we get 
h[n] - 0.25ft[n - 2] = [2(-0.5) n + (0.5) n ]((j[n] + S[n - 1]) 

This simplifies further to h[n] — 0.25ft[n — 2] = 35[n] — 0.55[n — 1]. 

From this result, the difference equation is y[n] — 0.25y[n — 2] = 3 x[n) — 0.5x[n — 1]. 
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DRILL PROBLEM 3.18 

(a) Set up the difference equation corresponding to the impulse response h[n) = 2(—0.5)"u[n]. 

(b) Set up the difference equation corresponding to the impulse response h[n] = (0.5)”w[n] + S [n]. 

Answers: (a) y[n] + 0.5 y[n — 1] = 2a:[n] (b) y[n] — 0.5 y[n — 1] = 2a:[n] — 0.5x[n — 1] 


3.6.2 Difference Equations from Input-Output Data 

The difference equation of LTI systems may also be obtained from input-output data. The response of the 
system described by y[n\ = 3x[n] +2 x[n — 1] to x[n] = <5[n] is y[n\ = 3<5[n] +2 5[n— 1]. Turning things around, 
the input <5[n] and output 3(5[n] + 2<5[n — 1] then corresponds to the difference equation y[n] = 3x[n] + 2x[n— 1]. 
Note how the coefficients of the input match the output data (and vice versa). 


REVIEW PANEL 3.12 


Difference Equation of an LTI System from Input-Output Information 

Jf Jf 

Example: If x[n\ = {l, 2, 3} and y[n] = {3, 3}, then y[n] + 2 y[n — 1] + 3 y[n — 2] = 3x[n] + 3x[n — 1]. 


‘Input 


t Output 

2 1 3 J " 

System 

- 3j 3f 

I 1 n 


I 1 n 

1 2 


1 


System Equation 
y[n] + 2y[«-l] + 3y[«-2] = 3x[n\ + 3x[n-l] 


DRILL PROBLEM 3.19 

JJ. 

(a) The impulse response of an LTI system is h[n] = {l, 2, —1}. What is the system equation? 

Jf Jj- 

(b) The input {2, 4} to an LTI system gives the output {3, —1}- What is the system equation? 

Answers: (a) y[n] = x[n\ + 2 x[n — 1] — x[n — 2] (b) 2 y[n] + 4 y[n — 1] = 3x[?r] — x[n — 1] 


3.7 Application-Oriented Examples 

In this section we explore various practical applications of digital filters such as signal smoothing using 
averaging filters, echo cancellation using inverse filters, special audio effects using echo and reverb, and 
wave-table synthesis of musical tones for synthesizers. 

3.7.1 Moving Average Filters 

A moving average or running average filter is an FIR filter that replaces a signal value by an average of 
its neighboring values. The averaging process blurs the sharp details of the signal and results in an output 
that is a smoother version of the input. Moving average filtering is a simple way of smoothing a noisy signal 
and improving its signal-to-noise ratio. A causal L-point moving average (or averaging) filter replaces a 
signal value by the average of its past L samples and is defined by 

1 1 

y[n] = — [x[n] + x[n — 1] + x[n — 2] + • • • + x[n — (L — 1)] = — x[n — fc] (3.29) 

Lj -Lj ^ J 
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This is an L-point FIR filter whose impulse response is 

h[n]=j{ 1, 1, 1, 1, 1 } (3.30) 

L n - - -' 

L samples 

Figure 3.4 shows a noisy sinusoid and the output when it is passed through two moving average filters of 
different lengths. We see that the output of the 10-point filter is indeed a smoother version of the noisy 
input. Note that the output is a delayed version of the input and shows a start-up transient for about 10 
samples before the filter output settles down. This is typical of all filters. A filter of longer length will result 
in a longer transient. It should also produce better smoothing. While that may be generally true, we see 
that the 50-point averaging filter produces an output that is essentially zero after the initial transient. The 
reason is that the sinusoid also has a period of 50 samples and its 50-point running average is thus zero! 
This suggests that while averaging filters of longer lengths usually do a better job of signal smoothing, the 
peculiarities of a given signal may not always result in a useful output. 



0 50 100 150 



0 10 50 100 150 



0 50 100 150 

(d) Output of 50-point averaging filter 



0 50 100 150 


Figure 3.4 The response of two averaging filters to a noisy sinusoid 


3.7.2 Inverse Systems 

Inverse systems are quite important in practical applications. For example, a measurement system (such as 
a transducer) invariably affects (distorts) the signal being measured. To undo the effects of the distortion 
requires a system that acts as the inverse of the measurement system. If an input x[n\ to a system results 
in an output y[n\, then its inverse is a system that recovers the signal x[?r] in response to the input y[n], as 
illustrated in Figure 3.5. For invertible LTI systems described by difference equations, finding the inverse 
system is as easy as switching the input and output variables, as illustrated in the following example. 
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x[n] 


System 


yM 


Inverse system 


x[i 


Figure 3.5 A system and its inverse 


REVIEW PANEL 3.13 

Finding the Inverse of an LTI System? Try Switching the Input and Output 

System: y[n] + 2 y[n — 1] = 3at[n] + 4 x[n — 1] Inverse system: 3 y[n\ + 4 y[n — 1] = x[n] + 2 x[n — 1] 

How to find the inverse from the impulse response h[n\? Find the difference equation first. 


EXAMPLE 3.16 (Inverse Systems) 

(a) Refer to the interconnected system shown in Figure E3.16A(1). Find the difference equation of the 
inverse system, sketch a realization of each system, and find the output of each system. 


‘Input 

4 f ^ 

y[n] = x[n] - 0.5x[n-l] 


Inverse system 

1 ” 





1 


Figure E3.16A(1) The interconnected system for Example 3.16(a) 


The original system is described by y[n\ = x[n} — 0.5x[n — 1]. By switching the input and output, the 
inverse system is described by y[n] — 0.5j/[?z — 1] = x[n\. The realization of each system is shown in 
Figure E3.16A(2). Are they related? Yes. If you flip the realization of the echo system end-on-end 
and change the sign of the feedback signal , you get the inverse realization. 


Input ~]( 


_I_ 

z - 1 

r\ c 

L 




($) Ou 


Output 


,^r© 


Input 


0.5 


| Output 


Svstem Inverse svstem 

Figure E3.16A(2) Realization of the system and its inverse for Example 3.16(a) 


The response g[n\ of the first system is simply 

g[n] = (4 d[n] + 4 5{n — 1]) — (2<5[?z — 1] + 25[n — 2]) = 45[n] + 2 5{n — 1]) — 2 5{n — 2]) 

If we let the output of the second system be t/o[ n ]> we have 

yo[n] = 0.5t/o[?t — 1] + 4<5[?z] + 2 5{n — 1]) — 2i5[n — 2]) 

Recursive solution gives 

2/o[0] = 0.52 /o[— 1] + 4$[0] = 4 y 0 [l] = 0.5y 0 [0] + 2A[0] = 4 y 0 [2] = 0.5y 0 [l] - 2<5[0] = 0 

All subsequent values of yo[n\ are zero since the input terms are zero for n > 2. The output is thus 

Jf 

yo [n] = {4, 4}, the same as the input to the overall system. 
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(b) Consider the FIR filter y[n] = x[n\ + 2x[n — 1], Its inverse is found by switching the input and output 
as y[n] + 2y[n — 1] = x[n\. The inverse of an FIR filter always results in an HR filter (while the converse 
is not always true). 


DRILL PROBLEM 3.20 | 

(a) Consider the HR filter y\n\ + 2y[n — 1] = x[n\. What is the inverse system? Is it FIR or HR? 

(b) Consider the HR filter y[n] + 2y[n — 1] = x[n] + x[n — 1]. Is the inverse system FIR or HR? 

JJ. 

(c) Consider the FIR filter whose impulse response is h[n\ = {1, —0.4}. What is the impulse response of 
the inverse system? Is it FIR or HR? 

Answers: (a) y[n ] = x[n] +2x[n— 1], FIR (b) y[n] + y[n— 1] = x[n] +2x[n— 1], HR (c) 0.4)”w[n], HR 


Invertible Systems 

Not all systems have an inverse. For a system to have an inverse, or be invertible, distinct inputs must 
lead to distinct outputs. If a system produces an identical output for two different inputs, it does not have 
an inverse. For example, the system described by y[n\ = cos(a;[n]) is not invertible because different inputs 
(such as x[n ] + 2kn, k = 0, ±1, ±2 ...) yield an identical input. 


EXAMPLE 3.17 (Invertibility) 

(a) The nonlinear system y[n] = x 2 [n\ does not have an inverse. Two inputs, differing in sign, yield the 
same output. If we try to recover x[n] as \Jy[n], we run into a sign ambiguity. 


(b) The linear (but time-varying) decimating system y[n\ = x[2n] does not have an inverse. Two inputs, 
which differ in the samples discarded (for example, the signals {1,2,4, 5} and {1, 3,4,8} yield the same 
output {1, 4}). If we try to recover the original signal by interpolation, we cannot uniquely identify 
the original signal. 


(c) The linear (but time-varying) interpolating system y[n\ = x[n/2\ does have an inverse. Its inverse is a 
decimating system that discards the very samples inserted during interpolation and thus recovers the 
original signal exactly. 


DRILL PROBLEM 3.21 | 

(a) Is the system y[n] = e x ^ invertible? If so, what is the inverse system? 

(b) Is the system described by the impulse response h[n] = (0.5) n it[ n ] invertible? If so, what is the impulse 
response of the inverse system? 

Answers: (a) Yes, y[n] = ln(x[n]) (b) Yes, h[n] = <5[n] — 0.5<5[n — 1] 
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3.7.3 Echo and Reverb 

The digital processing of audio signals often involves digital filters to create various special effects such as 
echo and reverb, which are typical of modern-day studio sounds. An echo filter has the form 

y[n] = x[n] + ax[n — D] (an echo filter) (3.31) 

This describes an FIR filter whose output y[n] equals the input r x[n] and its delayed (by D samples) and 
attenuated (by a) replica of x[n\ (the echo term). Its realization is sketched in Figure 3.6. The ID-sample 
delay is implemented by a cascade of D delay elements and represented by the block marked z~ D . This 
filter is also called a comb filter (for reasons to be explained in later chapters). 


Input 




Ou 


An echo filter 


A reverb filter 


Figure 3.6 Echo and reverb filters 

Reverberations are due to multiple echoes (from the walls and other structures in a concert hall, for 
example). For simplicity, if we assume that the signal suffers the same delay D and the same attenuation a 
in each round-trip to the source, we may describe the action of reverb by 

y[n\ = x[n\ + ax[n — D] + a 2 x[n — 2D] + a 3 x[n — 3ID] + • • • (3.32) 

If we delay both sides by D units, we get 

ay[n — D] = ax[n — D] + a 2 x[n — 2D] + a 3 x[n — 3 D] + a 4 x[n — AD] + • • • (3.33) 

Subtracting the second equation from the first, we obtain a compact form for a reverb filter: 

y[n] — ay[n — D] = x[n\ (a reverb filter) (3.34) 

This is an HR filter whose realization is also sketched in Figure 3.6. Its form is reminiscent of the inverse of 
the echo system y[n] + ay[n — D] = x[n], but with a replaced by —a. 

In concept, it should be easy to tailor the simple reverb filter to simulate realistic effects by including 
more terms with different delays and attenuation. In practice, however, this is no easy task, and the filter 
designs used by commercial vendors in their applications are often proprietary. 

3.7.4 Periodic Sequences and Wave-Table Synthesis 

Electronic music synthesizers typically possess tone banks of stored tone sequences that are replicated and 
used in their original or delayed forms or combined to synthesize new sounds and generate various musical 
effects. The periodic versions of such sequences can be generated by filters that have a recursive form 
developed from a nonrecursive filter whose impulse response corresponds to one period of the periodic 
signal. The difference equation of such a recursive filter is given by 

y[n\ — y[n — N] = x\ [n] (IV-sample periodic signal generator) (3.35) 
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where X\ [n] corresponds to one period (N samples) of the signal x[ri\. This form actually describes a reverb 
system with no attenuation whose delay equals the period N. Hardware implementation often uses a circular 
buffer or wave-table (in which one period of the signal is stored), and cycling over it generates the periodic 
signal. The same wave-table can also be used to change the frequency (or period) of the signal (to double 
the frequency for example, we would cycle over alternate samples) or for storing a new signal. 


EXAMPLE 3.18 (Generating Periodic Signals Using Recursive Filters) 

Suppose we wish to generate the periodic signal x[n ] described by 

x[n\ = { 2, 3, 1, 6, 2, 3, 1, 6, 2, 3, 1, 6, 2, 3, 1, 6,...} 

The impulse response sequence of a nonrecursive filter that generates this signal is simply 
h[n] = { 2, 3, 1, 6, 2, 3, 1, 6, 2, 3, 1, 6, 2, 3, 1, 6,...} 

If we delay this sequence by one period (four samples), we obtain 

h[n — 4] = {0, 0, 0, 0, 2, 3, 1, 6, 2, 3, 1, 6, 2, 3, 1, 6, 2, 3, 1, 6,...} 
Subtracting the delayed sequence from the original gives us h[n] — h[n — 4] = {2, 3, 1, 6}. 

Its recursive form is y[n ] — y[n — 4] = aq[n], where xi[n\ = {2, 3, 1, 6} describes one period of x[n}. 


DRILL PROBLEM 3.22 | 

JJ- 

(a) What is the system equation of a filter whose impulse response is periodic with first period {1, 2}. 

(b) Find the response of the system y[n] — y[n — 3] = 2S[n] + 3S[n — 2]. 

Jf 

Answers: (a) y[n ] — y[n — 2] = x[n ] + 2 x[n — 1] (b) Periodic (N = 3) with period yi[n\ = {2, 0, 3} 


3.7.5 How Difference Equations Arise 

We conclude with some examples of difference equations, which arise in many ways in various fields ranging 
from mathematics and engineering to economics and biology. 

1. y[n] = y[n - 1] + n, y[- 1] = 1 

This difference equation describes the number of regions y[n\ into which n lines divide a plane if no 
two lines are parallel and no three lines intersect. 

2. y[n + 1] = (n+ l)(y[n] + 1), y[0] = 0 

This difference equation describes the number of multiplications y[n\ required to compute the deter¬ 
minant of an n x n matrix using cofactors. 

3. y[n + 2]=y[n+l] + y[n], y[0] = 0, y[l) = 1 

This difference equation generates the Fibonacci sequence {y[n] =0, 1, 1, 2, 3, 5,...}, where each 
number is the sum of the previous two. 

4. y[n + 2] - 2 xy[n + 1] + y[n] = 0, y[0] = 1, y[ 1] = x 

This difference equation generates the Chebyshev polynomials T n {x) = y[n} of the first kind. We 
find that T 2 (x) = y{ 2] = 2a: 2 — 1, T 3 (x ) = y[3] = 4a; 3 — 3a:, etc. Similar difference equations called 
recurrence relations form the basis for generating other polynomial sets. 
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5. y[n + 1] = ay[n\( 1 - y[n]) 

This difference equation, called a logistic equation in biology, is used to model the growth of populations 
that reproduce at discrete intervals. 

6. y[n + 1] = (1 + a)y[n] + d[n\ 

This difference equation describes the bank balance y[n] at the beginning of the nth-compounding 
period (day, month, etc.) if the percent interest rate is a per compounding period and d[n] is the 
amount deposited in that period. 


3.8 Discrete Convolution 

Discrete-time convolution is a method of finding the zero-state response of relaxed linear time-invariant 
(LTI) systems. It is based on the concepts of linearity and time invariance and assumes that the system 
information is known in terms of its impulse response h[n\. In other words, if the input is 6[n], a unit sample 
at the origin n = 0, the system response is h[n]. Now, if the input is cc[0]<5|n], a scaled impulse at the origin, 
the response is x[Q]h[n] (by linearity). Similarly, if the input is the shifted impulse a;[l]<5[n — 1] at n = 1, the 
response is x[l]/i[n — 1] (by time invariance). The response to the shifted impulse x[fc]<5[n — k] at n = k is 
x[k]h[n — k] (by linearity and time invariance). Since an arbitrary input x[n ] is simply a sequence of samples, 
it can be described by a sum of scaled and shifted impulses: 

OO 

x[n]= ^ x[k]S[n — k] (3.36) 

k ——oo 

By superposition, the response to x[n] is the sum of scaled and shifted versions of the impulse response: 

OO 

y[n\ = x[k]h[n — k\ = x[n\-k h[n\ (3.37) 

k— — oo 

This defines the convolution operation and is also called linear convolution or the convolution sum, and 
denoted by y[n ] = a:[n]*/i[n] (or by x\n\ *h[n] in the figures) in this book. The order in which we perform the 
operation does not matter, and we can interchange the arguments of x and h without affecting the result. 

OO OO 

x[k]h[n — k] = x[n — k]h[k] or x[n] *h[n\ = h[n] *x[n] (3.38) 

k——oo k =—oo 


REVIEW PANEL 3.14 


Convolution Yields the Zero-State Response of an LTI System 


Input x[n] 


System 

impulse response = h[n] 


Output y[n] = x[n]*h[n] = h[n]*x[n] 
Output = convolution of x[nJ and h[n] 


OO 

Notation: We use x[n\ * h[n] to denote ^ x[k]h[n — k] 

k— — oo 


3.8.1 Analytical Evaluation of Discrete Convolution 

If x[n ] and h[n] are described by simple enough analytical expressions, the convolution sum can be imple¬ 
mented quite readily to obtain closed-form results. While evaluating the convolution sum, it is useful to 
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keep in mind that x[k\ and h[n — k] are functions of the summation variable k. For causal signals of the 
form x[n]u[n] and /i[n]u[n], the summation involves step functions of the form u[k\ and u[n — k\. Since 
u[k\ = 0, k < 0 and u[n — k] = 0, k > n, these can be used to simplify the lower and upper summation 
limits to k = 0 and k = n, respectively. 


EXAMPLE 3.19 (Analytical Evaluation of Discrete Convolution) 

(a) Let x[n ] = h[n] = u[n]. Then x[k] = u[k] and h[n—k] = u[n—k\. The lower limit on the convolution sum 
simplifies to k = 0 (because u[k] = 0, k < 0), the upper limit to k = n (because u[n — fc] = 0, k > n), 
and we get 

oo n 

y[n ] = Y^ u[k\u[n — k] = Y^ 1 = {n + l)u[n] = r[n + 1] 

k ——oo k= 0 

Note that (n + l)u[n\ also equals r[n + 1], and thus u[n] * w[n] = r[n + 1]. 


(b) Let x[n] = h[n\ = a n u[n}. Then x[fc] = a k u[k\ and h{n — k] = a n ~ k u[n — k]. The lower limit on the 
convolution sum simplifies to k = 0 (because u[k] =0, k < 0), the upper limit to k = n (because 
u[n — k) = 0, k > n), and we get 

oo n n 

y[n\ = ^ a k a n ~ k u[k\u[n — k] = ^ a k a n ~ k = a n 1 = (n + 1 )a n u[n] 

k——oo k—0 k =0 

The argument of the step function u[n] is based on the fact that the upper limit on the summation 
must exceed or equal the lower limit (i.e. n > 0). 


(c) Let x[n ] = u[n — 1] and h[n ] = a n u[n — 1]. Then 

oo n -1 ( _ n\ 

u[n — 1] * a n u[n — 1] = a k u[k — 1 ]u[n — 1 — k] = a k = — -— u[n — 2] 

k— —oo k—1 

Here, we used the closed form result for the finite summation. The argument of the step function 
u[n — 2] is dictated by the fact that the upper limit on the summation must exceed or equal the lower 
limit (i.e. n — 1 > 1 or n > 2). 


(d) Let x[n] = (0.8) n u[n] and h[n] = (0.4) n tt[?r]. Then 

oo n 

y[n\ = Y, {0.8) k u[k}{0A) n - k u[n - k] = Y (0.8) fe (0.4)"- fc = (0.4)" Y 2 


k =—c 


k—0 


k 

k—0 
n /qti+1 


l-2 n+1 

Using the closed-form result for the sum, we get y[n] = (0.4)"—-—-— = (0.4)"(2" + — l)w[n]. 
This may also be expressed as y[n] = [2(0.8) n — (0.4)"]u[n]. 


(e) Let x[n ] = nu[n} and h[n] = a n u[n — 1], a < 1. With h[n — k ] = a ( n k ^u[n — 1 — k] and x[k] = ku[k], 
the lower and upper limits on the convolution sum become k = 0 and k — n — 1. Then 

n- 1 n -1 - n+\ 

y[n] = Y ka~ {n ~ k) = a~ n Y kak = ,, [1 - na n ~ l + (n - 1 )a n ]u[n - 1] 

k—0 fe=0 “ G > 
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Here, we used known results for the finite summation to generate the closed-form solution. 


DRILL PROBLEM 3.23 

(a) Let x[n] = (0.8) n «[n] and h[n] = (0.4) n «[n- 1]. Find their convolution. 

(b) Let x[ri\ = (0.8) n it[n — 1] and h[n] = (0.4)"w[n]. Find their convolution. 

(c) Let x[n ] = (0.8)"u[n — 1] and h[n ] = (0.4)"u[n — 1]. Find their convolution. 

Answers: (a) [(0.8) n - (0.4) n ]u[n - 1] (b) 2[(0.8) n - (0.4) n ]u[n - 1] (c) [(0.8) n - 2(0.4)"]u[n - 2] 


3.9 Convolution Properties 

Many of the properties of discrete convolution are based on linearity and time invariance. For example, if 
x[n] (or h,[n\) is shifted by Uq, so is y[n]. Thus, if y[n\ = x[n] * h[n\, then 

x[n — no] * h[n] = x[n] * h[n — no] = y[n — no] (3.39) 

The sum of the samples in x[n ], h[n], and y [n] are related by 

oo / oo \ / oo \ 

X! w[n] = I *[”] ) ( /l M ) ( 3 - 40 ) 

n——oo \n=— oo / \n=— oo / 

For causal systems (h[n\ =0, n < 0) and causal signals (x[?r] =0, n < 0), y[n] is also causal. Thus, 

n n 

y[n ] = x[n) * h[n] = h[n ] * x[?r] = x[k]h[n — k) = h{k]x[n — k\ (3-41) 

k =0 k —o 

An extension of this result is that the convolution of two left-sided signals is also left-sided and the convolution 
of two right-sided signals is also right-sided. 


EXAMPLE 3.20 (Properties of Convolution) 

(a) Here are two useful convolution results that are readily found from the defining relation: 

5{n] -kx[n] = x[n] 5{n ] * J[n] = A[?z] 


(b) We find y [n] = u[n] * x[n}. Since the step response is the running sum of the impulse response, the 
convolution of a signal x[n\ with a unit step is the running sum of the signal x[n]: 

n 

x{n\-ku[n]= x[k\ 

k=— oo 


(c) We find y[n] = rect(n/2N ) *rect(?r/2A) where rect(?r/2A) = u[n+ A] — u[n — N — 1]. 

The convolution contains four terms: 

y[n} = u[n + N]*u[n + N] — u[n+ N]*u[n— N — 1 ] —u[n — N — l]-ku[n + N] + u[n—N — l]-ku[n—N — l) 
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Using the result u[n] * u[n] = r[n + 1] and the shifting property, we obtain 

( Tl 
-——— 

The convolution of two rect functions (with identical arguments) is thus a tri function. 


DRILL PROBLEM 3.24 

(a) Let x[n] = (0.8)" +1 u[n + 1] and h[n\ = (0.4)" _1 it[n — 2]. Find their convolution. 

(b) Let x[n\ = (0.8) n it[n] and h[n] = (0.4)" -1 «[n — 2]. Find their convolution. 

Answers: (a) [(0.8) ra — (0.4)”]w[n — 1] (b) [(0.8)" -1 — (0.4)" _1 ]u[n — 2] 


3.10 Convolution of Finite Sequences 

In practice, we often deal with sequences of finite length, and their convolution may be found by several 
methods. The convolution y[n] of two finite-length sequences x[n\ and h[n] is also of finite length and is 
subject to the following rules, which serve as useful consistency checks: 

1. The starting index of y[n] equals the sum of the starting indices of x [n] and h[n]. 

2. The ending index of y[n] equals the sum of the ending indices of x[n] and h[n\. 

3. The length L y of y[n] is related to the lengths L x and Lh of x [n] and h[n] by L y = L x + Lh — 1. 

3.10.1 The Sum-by-Column Method 

This method is based on the idea that the convolution y[n] equals the sum of the (shifted) impulse responses 
due to each of the impulses that make up the input x[n]. To find the convolution, we set up a row of index 
values beginning with the starting index of the convolution and h[n] and x\n] below it. We regard x[n\ as a 
sequence of weighted shifted impulses. Each element (impulse) of x[n] generates a shifted impulse response 
(product with h[n\) starting at its index (to indicate the shift). Summing the response (by columns) gives 
the discrete convolution. Note that none of the sequences is folded. It is better (if only to save paper) to let 
x[n\ be the shorter sequence. The starting index (and the marker location corresponding to n = 0) for the 
convolution y[n] is found from the starting indices of x [n] and h{n\. 


| REVIEW PANEL 3.15 | 

Discrete Convolution Using the Sum-by-Column Method 

1. Line up the sequence x[n\ below the sequence h[n\. 

2. Line up with each sample of x[n], the product of the entire array h[n } with that sample of x[n]. 

3. Sum the columns of the (successively shifted) arrays to generate the convolution sequence. 


EXAMPLE 3.21 (Convolution of Finite-Length Signals) 

4 

(a) An FIR (finite impulse response) filter has an impulse response given by h[n) = {l, 2, 2, 3}. Find its 

4 

response y[n] to the input x[n ] = {2, —1, 3}. Assume that both x[n] and h[n ] start at n = 0. 
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The paper-and-pencil method expresses the input as x[n] = 26[n] — 8[n — 1] + 3<5[?z — 2] and tabulates 
the response to each impulse and the total response as follows: 


/i[n] 

x[n] 


= 1 

= 2 

2 

-1 

2 

3 

3 


Input 

Response 






25[n] 

2 h[n\ 

= 2 

4 

4 

6 


— S[n — 1] 

—h[n — 1] 

= 

-1 

—2 

—2 

-3 

3 S[n - 2] 

3 h[n - 2] 

= 


3 

6 

6 9 

Sum = x[n] 

Sum = y[n] 

= 2 

3 

5 

10 

3 9 


So, y[n] = {2, 3, 5, 10, 3, 9} = 25[n\ + 3<5[n — 1] + 5<5[n — 2] + 10<5[n — 3] + 3 6[n — 4] + 9 6[n — 5]. 
The convolution process is illustrated graphically in Figure E3.21A. 



Figure E3.21A The discrete convolution for Example 3.21(a) 


Jf Jf 

(b) Let h[n] = {2, 5, 0, 4} and x[n\ = {4, 1, 3}. 

We note that the convolution starts at n = — 3 and use this to set up the index array and generate the 
convolution as follows: 
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n 

-3 

-2 

-1 

0 

1 

2 

h[n\ 

2 

5 

0 

4 



x[n] 

4 

1 

3 





8 

20 

0 

16 





2 

5 

0 

4 





6 

15 

0 

12 





4 



y[n] 

8 

22 

11 

31 

4 

12 


The marker is placed by noting that the convolution starts at n = —3, and we get 

y[n] = {8, 22, 11, 31, 4, 12} 


4 

(c) (Response of a Moving-Average Filter) Let x[n] = {2, 4, 6, 8, 10, 12, 

4 

What system will result in the response y[n ] = (l, 3, 5, 7, 9, 11, ...}? 

At each instant, the response is the average of the input and its previous value. This system describes 
an averaging or moving average filter. Its difference equation is simply y[n\ = 0.5(x[n] + x[n — 1]). 

4 

Its impulse response is thus h[n] = 0.5{<5[?x] + 6[n — 1]}, or h[n] = {0.5, 0.5}. 

Using discrete convolution, we find the response as follows: 


x : 

h : 

2 

1 

2 

4 

1 

2 

6 

8 

10 

12 ... 


l 

2 

3 

4 

5 

6 ... 



1 

2 

3 

4 

5 6 

y■ 

l 

3 

5 

7 

9 

11 ... 


This result is indeed the averaging operation we expected. 


DRILL PROBLEM 3.25 

4 4 

(a) Let x[n] = {l, 4, 0, 2} and h[n] = {1, 2, 1}. Find their convolution. 

4 4 

(b) Let x[n] = {1, 4, 1, 3} and h[n] = {2, 1, —1}. Find their convolution. 

4 4 

Answers: (a) {1, 6, 9, 6, 4, 2} (b) {2, 9, 5, 3, 2, —3} 


3.10.2 The Fold, Shift, Multiply, and Sum Concept 

The convolution sum may also be interpreted as follows. We fold x[n ] and shift x[—n] to line up its last 
element with the first element of h.[n\. We then successively shift x[—n] (to the right) past h[n], one index 
at a time, and find the convolution at each index as the sum of the pointwise products of the overlapping 
samples. One method of computing y[n] is to list the values of the folded function on a strip of paper and 
slide it along the stationary function, to better visualize the process. This technique has prompted the name 
sliding strip method. We simulate this method by showing the successive positions of the stationary and 
folded sequence along with the resulting products, the convolution sum, and the actual convolution. 
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EXAMPLE 3.22 (Convolution by the Sliding Strip Method) 

4 4 

Find the convolution of h[n} = {2, 5, 0, 4} and x[n ] = {4, 1, 3}. 


Since both sequences start at n = 0, the folded sequence is x[—k\ = {3, 1, 4}. 

We line up the folded sequence below h[n] to begin overlap and shift it successively, summing the product 
sequence as we go, to obtain the discrete convolution. The results are computed in Figure E3.22. 

4 

The discrete convolution is y[n\ = {8, 22, 11, 31, 4, 12}. 


2 

5 0 4 

2 5 

0 4 

2 

5 0 

4 

3 1 4 

Slide. 

3 1 4 

i Slide K 

1 =^> 

3 

1 4 



8 2 20 6 5 0 


y[0] = sum of products =8 y[l] = sum of products = 22 y[2] = sum of products =11 


2 

5 

0 

4 

2 5 

0 

4 

2 5 0 

4 


3 

1 

4 

! Slide K 

3 

1 4 

Slide K 

3 1 4 


1 > 

> 


15 

0 

16 


0 

4 


12 


vT31 = sum of products =31 >441 = sum of products = 4 yT51 = sum of products = 12 

Figure E3.22 The discrete signals for Example 3.22 and their convolution 


3.10.3 Discrete Convolution, Multiplication, and Zero Insertion 

The discrete convolution of two finite-length sequences x[n\ and h[n\ is entirely equivalent to multiplication 
of two polynomials whose coefficients are described by the arrays x[n\ and h[n] (in ascending or descending 
order). The convolution sequence corresponds to the coefficients of the product polynomial. Based on this 
result, if we insert N zeros between each pair of adjacent samples of each sequence to be convolved, their 
convolution corresponds to the original convolution sequence with N zeros inserted between each pair of its 
adjacent samples. 

If we append zeros to one of the convolved sequences, the convolution result will also show as many appended 
zeros at the corresponding location. For example, leading zeros appended to a sequence will appear as leading 
zeros in the convolution result. Similarly, trailing zeros appended to a sequence will show up as trailing zeros 
in the convolution. 


REVIEW PANEL 3.16 

Convolution of Finite-Length Signals Corresponds to Polynomial Multiplication 

Jf Jf Jf 

Example: {1, 1, 3}*{l, 0, 2} = {1, 1, 5, 2, 6} (x 2 + x + 3) (x 2 + 2) = x 4 + x 3 + 5x 2 + 2x + 6 

Zero Insertion of Both Sequences Leads to Zero Insertion of the Convolution 
Example: If {l, 2} * {3, 1, 4} = {3, 7, 6, 8} 

Then, {l, 0, 0, 2} *{3,0, 0, 1, 0, 0, 4} = {3, 0, 0, 7, 0, 0, 6, 0, 0, 8} 

Zero-Padding of One Sequence Leads to Zero-Padding of the Convolution 
Example: If x [n] * h[n\ = y[n\ then {0, 0,a;[n], 0, 0}*{/i[n], 0} = {0, 0, y[n], 0, 0, 0}. 
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EXAMPLE 3.23 (Polynomial Multiplication, Zero Insertion, Zero-Padding) 

4 4 

(a) Let h[n] = {2, 5, 0, 4} and x[n\ = {4, 1, 3}. To find their convolution, we set up the polynomials 

h(z) = 2z 3 + 5 z 2 + 0a + 4 x(z) = 4 z 2 + lz + 3 

Their product is y(z) = 8a 5 + 22a 4 + 11a 3 + 31a; 2 + 4 z + 12. 

4 

The convolution is thus y[n] = {8, 22, 11, 31, 4, 12}. 


(b) (Zero-Insertion) Zero insertion of each convolved sequence gives 

h\[n] = {2, 0, 5, 0, 0, 0, 4} aq[n] = {4, 0, 1, 0, 3} 

To find their convolution, we set up the polynomials 

h\{z) = 2z 6 + 5 a: 4 + 0a 2 + 4 Xl (a) = 4a 4 + la 2 + 3 

Their product is j/i(a) = 8a 10 + 22a 8 + 11a 6 + 31a 4 + 4a 2 + 12. 

4 

The convolution is then yi[n] = {8, 0, 22, 0, 11, 0, 31, 0, 4, 0, 12}. 

This result is just y[n} with zeros inserted between adjacent samples. 

(c) (Zero-Padding) If we pad the first sequence by two zeros and the second by one zero, we get 

h 2 [n] = {2, 5, 0, 4, 0, 0} x 2 [n] = {4, 1, 3, 0} 

To find their convolution, we set up the polynomials 

h 2 (z) = 2a 5 + 5a 4 + 4a 2 x 2 (a) = 4a 3 + la 2 + 3a 

Their product is y 2 (z) = 8a 8 + 22a 7 + 11a 6 + 31a 5 + 4a 4 + 12a 3 . 

4 

The convolution is then yi[n] = {8, 22, 11, 31, 4, 12, 0, 0, 0}. 

This result is just y[n\ with three zeros appended at the end. 


DRILL PROBLEM 3.26 

4 4 4 

Use the result {l, 0, 2}*{l, 3} = {1, 3, 2, 6} to answer the following. 

4 4 

(a) Let x[n] = {l, 0, 0, 0, 2} and h[n ] = {l, 0, 3}. Find their convolution. 

4 4 

(b) Let x[n] = {I, 0, 2, 0} and h[n\ = {I, 3, 0, 0}. Find their convolution. 

4 4 

(c) Let x[n ] = {0, 0, 1, 0, 2} and h[n ] = {l, 3, 0}. Find their convolution. 

Answers: (a) {1, 0, 3, 0, 2, 0, 6} (b) {1, 3, 2, 6, 0, 0, 0} (c) {0, 0, 1, 3, 2, 6, 0} 
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3.10.4 Impulse Response of LTI Systems in Cascade and Parallel 

Consider the ideal cascade of two LTI systems shown in Figure 3.7. The response of the first system is 
j/i [n] = x[n] * hi[n\. The response y[n] of the second system is 

y[n] = j/i [n] * h 2 [n] = (x[n] * h\[n]) * h 2 [n] = x[n] * (hi[n] ★ h 2 [n]) (3.42) 

If we wish to replace the cascaded system by an equivalent LTI system with impulse response h[n\ such that 
y[n] = x[n] * h[n], it follows that h[n] = h\[n] * h 2 [n]. Generalizing this result, the impulse response h[n] of 
N ideally cascaded LTI systems is simply the convolution of the N individual impulse responses 

h[n] = hi[n] * h 2 [n]*---*/ijv[n] (for a cascade combination) (3.43) 

If the hk[n] are energy signals, the order of cascading is unimportant. 


x[ri\ 


Two LTI systems in cascade 

yl'd 


h x [n\ 


h 2 [n] 


Equivalent LTI system 
7^ x[n] 


h t \n\t- h 2 [n\ 


}’ln I 


Two LTI systems in parallel 

X |/7 1 



y[n\ 


Equivalent LTI system 
7^ x[n\ 




}’[n| 


Figure 3.7 Cascaded and parallel systems and their equivalents 


The overall impulse response of LTI systems in parallel equals the sum of the individual impulse responses, 
as shown in Figure 3.7: 

hp[n} = hi[n] + h 2 [n] H-+ /ijv[n] (for a parallel combination) (3.44) 


REVIEW PANEL 3.17 

Impulse Response of N Interconnected Discrete LTI Systems 
In cascade: Convolve the impulse responses: hc[n] = h\[n] * h 2 [n\ * • • • ★ /ijv[n] 
In parallel: Add the impulse responses: hp[n] = h\[n] + h 2 [n] + ■ ■ ■ + hpr [n] 


EXAMPLE 3.24 (Interconnected Systems) 

Consider the interconnected system of Figure E3.24. Find its overall impulse response and the output. 
Comment on the results. 


‘ Input 




Out] 

4t 

y [n] = x[n\ - 0.5.V[/«—1] 


h[n] = (0.5 ) n u[n] 

_L- 




1 

Figure E3.24 The interconnected system of Example 3.24 
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The impulse response of the first system is h\ [n] = <5[n] — 0.5<5[?r — 1]. The overall impulse response hc[n\ 
is given by the convolution 


hc[n ] = (<5[?z] — 0.5<5[n — 1]) * (0.5)"w[n] = (0.5)"w[?r] — 0.5(0.5) n 1 u[n — 1] 

This simplifies to 

hc[n] = (0.5) n ('u[n] — u[n — 1]) = (0.5) n c)[?r] = <5[n] 

What this means is that the overall system output equals the applied input. The second system thus acts 
as the inverse of the first. 


DRILL PROBLEM 3.27 

Jj. 

(a) Find the impulse response of the cascade of two identical filters, each with h[n\ = {1, 1, 3}. 

Jf 4 

(b) The impulse response of two filters is hi[n) = {1, 0, 2} and h 2 [n\ = {4, 1 , 3}. Find the impulse 
response of their parallel combination. 

(c) Two filters are described by y[n] — 0Ay[n — 1] = x[n} and h 2 [n] = 2(0.4) n u[n]. Find the impulse 
response of their parallel combination and cascaded combination. 

Answers: (a) {l, 2, 7, 6, 9} (b) {4, 2, 3, 2} (c) hp[n\ = 3(0.4) n rt[n], hc[n] = 2(n +l)(0.4) ra u[n] 


3.11 Stability and Causality of LTI Systems 

System stability is an important practical constraint in filter design and is defined in various ways. Here we 
introduce the concept of Bounded-input, bounded-output (BIBO) stability that requires every bounded 
input to produce a bounded output. 

3.11.1 Stability of FIR Filters 

The system equation of an FIR filter describes the output as a weighted sum of shifted inputs. If the input 
remains bounded, the weighted sum of the inputs is also bounded. In other words, FIR filters are always 
stable. This can be a huge design advantage. 

3.11.2 Stability of LTI Systems Described by Difference Equations 

For an LTI system described by the difference equation 

y[n] + Aiy[n — 1] + • • • + Apiy[n — N] = Box[n] + B\x[n — 1] + • • • + Bmx[ti — M] (3.45) 

the conditions for BIBO stability involve the roots of the characteristic equation. A necessary and sufficient 
condition for BIBO stability of such an LTI system is that every root of its characteristic equation must have 
a magnitude less than unity. This criterion is based on the results of Tables 3.1 and 3.2. Root magnitudes 
less than unity ensure that the natural (and zero-input) response always decays with time (see Table 3.2), 
and the forced (and zero-state) response always remains bounded for every bounded input. Roots with 
magnitudes that equal unity make the system unstable. Simple (non-repeated) roots with unit magnitude 
produce a constant (or sinusoidal) natural response that is bounded; but if the input is also a constant 
(or sinusoid at the same frequency), the forced response is a ramp or growing sinusoid (see Table 3.1) and 
hence unbounded. Repeated roots with unit magnitude result in a natural response that is itself a growing 
sinusoid or polynomial and thus unbounded. In the next chapter, we shall see that the stability condition 
is equivalent to having an LTI system whose impulse response h[n] is absolutely summable. The stability of 
nonlinear or time-varying systems usually must be checked by other means. 
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3.11.3 Stability of LTI Systems Described by the Impulse Response 

For systems described by their impulse response, it turns out that BIBO stability requires that the impulse 
response h[n] be absolutely summable. Here is why. If x[n] is bounded such that |a;[n]| < M, so too is its 
shifted version x[n — k\. The convolution sum then yields the following inequality: 

oo oo 

\y[n}\< Y \h[k\\\x[n - k\\ < M Y IM fc ]l ( 3 - 46 ) 

k=—oo k =—oo 

If the output is to remain bounded (|j/[n]| < oo), then 

OO 

Y^ | A [A] | < oo (for a stable LTI system) (3.47) 

k =—oo 

In other words, h[n\ must be absolutely summable. This is both a necessary and sufficient condition. The 
stability of nonlinear systems must be investigated by other means. 

3.11.4 Causality 

In analogy with analog systems, causality of discrete-time systems implies a non-anticipating system with 
an impulse response h[n] = 0,n < 0. This ensures that an input x[n}u[n — no] starting at n = no results in 
a response y[n] also starting at n = no (and not earlier). This follows from the convolution sum: 

oo n 

y[n] = Y^ x[k]u(k — no\h[n — k]u[n — k] = x[k]h[n — fc] (3.48) 

k —oo no 


| REVIEW PANEL 3.18 | 

Stability and Causality of Discrete LTI Systems 

Stability: Every root r of the characteristic equation must have magnitude |r| less than unity. 

OO 

The impulse response h[n] must be absolutely summable with Y^ IM^]I < °°- 

k ——oo 

Note: FIR filters are always stable. 

Causality: The impulse response h[n\ must be zero for negative indices ( h[n\ =0, n < 0). 


EXAMPLE 3.25 (Concepts Based on Stability and Causality) 

(a) The system y[n] — \y[n — 1] — \y[n — 2] = x[n] is stable since the roots of its characteristic equation 
z 2 — \z — g=0 are z\ = \ and z^ = — | and their magnitudes are less than 1. 


(b) The system y[n] — y[n — 1] = x[n] is unstable. The root of its characteristic equation z — 1 = 0 is z = 1 
gives the natural response yu = Ku[n], which is actually bounded. However, for an input x[n ] = u[n\, 
the forced response will have the form Cnu[n], which becomes unbounded. 
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(c) The system y[n] — 2 y[n — 1] + y[n — 2] = x[n\ is unstable. The roots of its characteristic equation 
z 2 — 2z + 1 = 0 are equal and produce the unbounded natural response j/at[u] = Au[n] + Bnu[n]. 


(d) The system y[n\ — \y[n — 1] = nx[n\ is linear, time varying and unstable. The (bounded) step input 
x[n] = u[n ] results in a response that includes the ramp nu[n], which becomes unbounded. 


(e) The system y[n] = x[n} — 2 x[n — 1] is stable because it describes an FIR filter. 


(f) The FIR filter described by y[n] = x[n + 1] — x[n] has the impulse response h[n] = {1, — l}. It is a 
stable system, since \h[n]\ = |1| + | — 1| = 2. It is also noncausal because h[n] = S[n + 1] — <5[n] is 
not zero for n < 0. We emphasize that FIR filters are always stable because \h[n]\ is the absolute 
sum of a finite sequence and is thus always finite. 


(g) A filter described by h[n] = (—0.5) ra u[?r] is causal. It describes a system with the difference equation 
y[n] = x[n] + ay[n — 1]. It is also stable because IM n ll is finite. In fact, we find that 


CX_> CXJ ^ 

E IM»]l = EH)- 5 )" = nra5 = 2 

n =—oo n—0 


(h) A filter described by the difference equation y[n] — 0.5 y[n — 1] = nx[n] is causal but time varying. It 
is also unstable. If we apply a step input u[n\ (bounded input), then y[n] = nu[n\ + 0.5 y[n — 1]. The 
term nu[n\ grows without bound and makes this system unstable. We caution you that this approach 
is not a formal way of checking for the stability of time-varying systems. 


DRILL PROBLEM 3.28 


(a) Is the filter described by h[n ] = {2, 1, 1, 3} causal? Is it stable? 

(b) Is the filter described by h[n] = 2 n u[n + 2] causal? Is it stable? 

(c) Is the filter described by y[n] + 0.5 y[n — 1] = 4u[n] causal? Is it stable? 

(d) Is the filter described by y[n] + 1.5y[n — 1] + 0.5 y[n — 2] = u[n] causal? Is it stable? 

Answers: (a) Noncausal, stable (b) Noncausal, unstable (c) Causal, stable (d) Causal, unstable 


3.12 System Response to Periodic Inputs 

In analogy with analog systems, the response of a discrete-time system to a periodic input with period N is 
also periodic with the same period N. A simple example demonstrates this concept. 
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EXAMPLE 3.26 (Response to Periodic Inputs) 

(a) Let x[n ] = {l, 2, —3, 1, 2, —3, 1, 2, —3,...} and h[n] = {l, 1}. 

The convolution y[n ] = x[n\ * h[n\, using the sum-by-column method, is 


Index n 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 10 

x[n] 

1 

2 

-3 

1 

2 

-3 

1 

2 

-3 

1 ... 

h[n] 

1 

1 










1 

2 

-3 

1 

2 

-3 

1 

2 

-3 

1 ... 



1 

2 

-3 

1 

2 

-3 

1 

2 

-3 ... 

y[n] 

1 

3 

-1 

-2 

3 

-1 

-2 

3 

-1 

-2 ... 


The convolution y[n] is periodic with period N = 3, except for start-up effects (which last for one 
period). One period of the convolution is y[n] = {—2, 3, —1}. 


4 4 

(b) Let x[n] = {l, 2, —3, 1, 2, —3, 1, 2, —3,...} and h[n ] = {l, 1, 1}. 

The convolution y[n ] = x[n\ * h[n], using the sum-by-column method, is found as follows: 


Index ?i 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 10 

x[n} 

1 

2 

-3 

1 

2 

-3 

1 

2 

-3 

1 ... 

h[n} 

1 

1 

1 









1 

2 

-3 

1 

2 

-3 

1 

2 

-3 

1 ... 



1 

2 

—3 

1 

2 

-3 

1 

2 

—3 ... 




1 

2 

—3 

1 

2 

—3 

1 

2 ... 

y[n] 

1 

3 

0 

0 

0 

0 

0 

0 

0 

0 ... 


Except for start-up effects, the convolution is zero. The system h[n] = {l, 1, 1} is a moving average 
filter. It extracts the 3-point running sum, which is always zero for the given periodic signal x[n\. 


REVIEW PANEL 3.19 

The Response of LTI Systems to Periodic Signals Is Also Periodic with Identical Period 


Periodic input 

Relaxed 

Periodic output 

Period = N 

LTI system 

Period = N 


One way to find the system response to periodic inputs is to find the response to one period of the input and 
then use superposition. In analogy with analog signals, if we add an absolutely summable signal (or energy 
signal) x[n\ and its infinitely many replicas shifted by multiples of N, we obtain a periodic signal with period 
N, which is called the periodic extension of x[n]: 

OO 

a: pe [n] = x[n + kN] (3.49) 

k— — oo 
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An equivalent way of finding one period of the periodic extension is to wrap around IV-sample sections of 
x [n] and add them all up. If x[n) is shorter than N , we obtain one period of its periodic extension simply 
by padding x[n] with zeros (to increase its length to N). 


EXAMPLE 3.27 (Periodic Extension) 


(a) The periodic extension of x[n] = {1, 5, 2, 0, 4, 3, 6, 7} with period IV = 3 is found by wrapping 
around blocks of 3 samples and finding the sum to give 


! JJ- 

1 5 2 

0 4 3 

6 7 


sum 


{7, 16, 5} 


In other words, if we add x[n] to its shifted versions x[n + kN] where N — 3 and k = ±1, ±2, ±3,..., 

JJ. 

we get a periodic signal whose first period is {7, 16, 5}. 


The periodic extension of the signal x[n\ = a n u[n] with period N is given by 


x pe [n]= J2 x[n + kN] = Y2a n+kN =a n J2(a N )k = 


k =—oo 


k=0 


k—0 


- - 0 < n < N — 1 

1 — a n 


The methods for finding the response of a discrete-time system to periodic inputs rely on the concepts of 
periodic extension and wraparound. One approach is to find the output for one period of the input (using 
regular convolution) and find one period of the periodic output by superposition (using periodic extension). 
Another approach is to first find one period of the periodic extension of the impulse response, then find its 
regular convolution with one period of the input and finally, wrap around the regular convolution to generate 
one period of the periodic output. 


EXAMPLE 3.28 (System Response to Periodic Inputs) 

JJ. 

(a) Let x [n] = {1, 2, —3} describe one period of a periodic input with period N = 3 to a system whose 

JJ. 

impulse response is h[n] = {l, 1}. The response y[n] is also periodic with period N = 3. To find y[n) 
for one period, we find the regular convolution y\[n\ of h[n] and one period of x [n] to give 


yi[n} = { 1, 1}*{1, 2, -3} = {1, 3, -1, -3} 

We then wrap around y\ [n] past three samples to obtain one period of y[n] as 


A 


JJ- 


1 3 -1 

-3 


{1, 3, —1, —3} => wrap around => 

This is identical to the result obtained in the previous example. 


sum 


{-2, 3, -1} 


(b) We find the response y p [n] of a moving average filter described by h[n} = {2, 1, 1, 3, 1} to a periodic 

JJ- 

signal whose one period is x p [n] = {2, 1, 3}, with N = 3, using two methods. 
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1. (Method 1) We find the regular convolution y[n] = x p [n] * h[n] to obtain 

y[n] = {2, 1, 3} * {2, 1, 1, 3, 1} = {4, 4, 9, 10, 8, 10, 3} 
To find y p [n], values past N = 3 are wrapped around and summed to give 


{4, 4, 9, 10, 8, 10, 3} => wrap around 


4 

4 4 9 
10 8 10 
3 


sum =4- {17, 12, 19} 


2. (Method 2) We first create the periodic extension of h[n], with N = 3, (by wraparound) to get 

4 

h p [n] = {5, 2, 1}. The regular convolution of h p [n] and one period of x[n] gives 

y[n] = { 2 , 1 ,3} * {5, 2,1} = {10, 9, 19, 7, 3} 

4 

This result is wrapped around past TV = 3 to give y p [n] = {17, 12, 19}, as before. 


(c) We find the response of the system y[n] — 0.5y[n — 1] = x[n\ to x[n] = {..., 7, 0, 0, 7, 0, 0,...}. 

The impulse response of the system is h[n] = (0.5)"w[n]. The input is periodic with period N = 3 

4 

and first period x\ = {7, 0, 0}. The response due to this one period is just yi[n] = 7(0.5)"w[n]. The 
complete periodic output is the periodic extension of yi[n] with period N = 3. Using the result that 
the periodic extension of a n u[rt] with period N is given by ; 0 < n < N — 1, we find one period 

of the periodic output as 

(0 5j n 4 

V P [n] = x ^ ^3 ) 0 < n < 2 = {8, 4, 2} 


DRILL PROBLEM 3.29 

4 

(a) A filter is described by h[n] = {2, 1, 1, 3, 2}. Find one period of its periodic output if the input is 

4 

periodic with first period Xi[n] = {l, 0, 0, 2}. 

(b) A filter is described by y[n\ — 0.5y[n — 1] = 7 x[n\. Find one period of its periodic output if the input 

4 

is periodic with first period x\[n] = {l, 0, 0}. 

(c) A filter is described by y[n] — 0.5y[?r — 1] = 7x[n\? Find one period of its periodic output if the input 

4 

is periodic with first period x\ [n] = {l, 0, 1}. 

Answers: (a) {6, 3, 7, 11} (b) {8, 4, 2} (c) {12, 6, 10} 
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3.13 Periodic Convolution 

The regular convolution of two signals, both of which are periodic, does not exist. For this reason, we resort 
to periodic convolution by using averages. If both x p [n } and h p [n\ are periodic with identical period N, 
their periodic convolution generates a convolution result y p [n] that is also periodic with the same period N. 
The periodic convolution or circular convolution y p [n] of x p [n] and h p [n\ is denoted y p [n] = x p [n}@h p [n} 
and, over one period (n = 0,1,..., N — 1), it is defined by 

N-l N-l 

y p [n] = x p [n]@h p [n] = h p [n]@x p [n] = x p [k\h p [n — k] = h p [k\x p [n — k] (3.50) 

k =0 fc=0 

An averaging factor of 1/N is sometimes included with the summation. Periodic convolution can be imple¬ 
mented using wraparound. We find the linear convolution of one period of x p [n] and h p [n], which will have 
(2 N — 1) samples. We then extend its length to 2 N (by appending a zero), slice it in two halves (of length 
N each), line up the second half with the first, and add the two halves to get the periodic convolution. 


REVIEW PANEL 3.20 

Periodic Convolution of Periodic Discrete-Time Signals with Identical Period N 

1. Find the regular convolution of their one-period segments (this will have length 2 N — 1). 

2. Append a trailing zero. Wrap around the last N samples and add to the first N samples. 


EXAMPLE 3.29 (Periodic Convolution) 

Jf Jf 

(a) Find the periodic convolution of x p [n] = {l, 0, 1, 1} and h p [n] = {1, 2, 3, 1}. 
The period is N = 4. First, we find the linear convolution y[n\. 


Index n 0123456 
h p [n\ 12 3 1 

x p [n] 10 11 


1 2 

3 

1 



0 

0 

0 

0 



1 

2 

3 

1 



1 

2 

3 1 

y[n] 1 2 

4 

4 

5 

4 1 


Then, we append a zero, wrap around the last four samples, and add. 


Index n 

0 

1 

2 

3 

First half of y[n\ 

1 

2 

4 

4 

Wrapped around half of y[n] 

5 

4 

1 

0 

Periodic convolution y p [n\ 

6 

6 

5 

4 


(b) Find the periodic convolution of x p [n] = {l, 2, 3} and h p [n] = {l, 0, 2}, with period N = 3. 

J! 

The regular convolution is easily found to be = {l, 2, 5, 4, 6}. 

J! 

Appending a zero and wrapping around the last three samples gives y p [n] = {5, 8, 5}. 
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DRILL PROBLEM 3.30 

J| 

Find the periodic convolution of two identical signals whose first period is given by x\[n] = {1, 2, 0, 2}. 

Jf 

Answer: {9, 4, 8, 4} 


3.13.1 Periodic Convolution By the Cyclic Method 

To find the periodic convolution, we shift the folded signal x p [—n\ past h p [n], one index at a time, and 
find the convolution at each index as the sum of the pointwise product of their samples but only over a 
one-period window (0 ,N — 1). Values of x p [n ] and h p [n] outside the range (0 ,N — 1) are generated by 
periodic extension. One way to visualize the process is to line up x[k\ clockwise around a circle and h[k\ 
counterclockwise (folded), on a concentric circle positioned to start the convolution, as shown in Figure 3.8. 



Figure 3.8 The cyclic method of circular (periodic) convolution 


Shifting the folded sequence turns it clockwise. At each turn, the convolution equals the sum of the 
pairwise products. This approach clearly brings out the cyclic nature of periodic convolution. 

3.13.2 Periodic Convolution By the Circulant Matrix 

Periodic convolution may also be expressed as a matrix multiplication. We set up an N x N matrix whose 
columns equal x[n] and its cyclically shifted versions (or whose rows equal successively shifted versions of 
the first period of the folded signal x[— ?r]). This is called the circulant matrix or convolution matrix. 
An N x TV circulant matrix C x for x[n\ has the general form 


o 

x[N — 1] 

x[2] x[l] 

*[1] 

x[0] ■ ■ ■ 

x[2] 

s[2] 

x[l] 

*[3] 

x[N — 2] 


x[0] x[N 

x[N — 1] 

x[N - 2] 

x[\] x[0] 


Note that each diagonal of the circulant matrix has equal values. Such a constant diagonal matrix is also 
called a Toeplitz matrix. Its matrix product with an N x 1 column matrix h describing h[n\ yields the 
periodic convolution y = Ch as an N x 1 column matrix. 
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EXAMPLE 3.30 (Periodic Convolution By the Circulant Matrix) 

J| JJ. 

Consider x[n] = {1, 0, 2} and h[n] = {l, 2, 3}, described over one period (N = 3). 
(a) The circulant matrix C x and periodic convolution y\ [?r] are given by 


' 1 

2 0 ' 


■ i' 


' 1 2 0 " 


' 1 ' 


' 5 ' 

0 

2 

1 2 

0 1 

h = 

2 

3 

2/i M = 

0 12 

2 0 1 


2 

3 


8 

5 


Comment: Though not required, normalization by N = 3 gives y p \[n] = —— = {|, |, |}. 


(b) The periodic convolution z /2 [n] of x[n\ and h[n] over a two-period window yields 


' 1 

2 

0 

1 

2 

0 ' 


' 1 ' 


' 10 ' 

0 

1 

2 

0 

1 

2 


2 


16 

2 

0 

1 

2 

0 

1 


3 


10 

1 

2 

0 

1 

2 

0 

h 2 = 

1 

2/2 M = 

10 

0 

1 

2 

0 

1 

2 


2 


16 

2 

0 

1 

2 

0 

1 


3 


10 


We see that 2 / 2 N has double the length (and values) of y-\ [n ], but it is still periodic with N = 3. 
Comment: Normalization by a two-period window width (6 samples) gives 


y P 2[n] = 


2/2 [nj 


= { 


1} 


6 L 3’ 3’ 3’ 3> 3’ 3- 

Note that one period (N = 3) of y P 2 [n} is identical to the normalized result y p i[n] of part (a). 


3.13.3 Regular Convolution from Periodic Convolution 

The linear convolution of x\n\ (with length N x ) and h[n\ (with length IV/,) may also be found using the 
periodic convolution of two zero-padded signals x z [n ] and h z [n} (each of length N y = N x + Nh — 1). The 
regular convolution of the original, unpadded sequences equals the periodic convolution of the zero-padded 
sequences. 


| REVIEW PANEL 3.21 | 

Regular Convolution from Periodic Convolution by Zero-Padding 

x[n] * h[n] = Periodic convolution of their zero-padded (each to length N x + Nh — 1) versions. 


EXAMPLE 3.31 (Regular Convolution by the Circulant Matrix) 

Let x[n] = { 2, 5, 0, 4} and h[n] = { 4, 1, 3}. Their regular convolution has S = M + N — 1 = 6 samples. 
Using trailing zeros, we create the padded sequences 


x zp [n] = {2, 5, 0, 4, 0, 0} 


h zp [n] = {4, 1, 3, 0, 0, 0} 
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The periodic convolution x zp [n] © h zp [n ], using the circulant matrix, equals 


' 2 

0 

0 

4 

0 

5 ' 


' 4 ' 


8 ' 

5 

2 

0 

0 

4 

0 


1 


22 

0 

5 

2 

0 

0 

4 


3 

y p [n\ = 

11 

4 

0 

5 

2 

0 

0 

h zp — 

0 

31 

0 

4 

0 

5 

2 

0 


0 


4 

0 

0 

4 

0 

5 

2 


0 


12 


This is identical to the regular convolution y[n\ = x[n] * h[n] obtained previously by several other methods 
in previous examples. 


DRILL PROBLEM 3.31 

Let x[n ] = {1, 2, 0, 2, 2} and h[n] = {3, 2}. 

(a) How many zeros must be appended to x[n] and h[n\ in order to generate their regular convolution 
from the periodic convolution of the zero-padded sequences. 

(b) What is the regular convolution of the zero-padded sequences? 

(c) What is the regular convolution of the original sequences? 

Answers: (a) 1, 4 (b) {3, 8, 4, 6, 10, 4, 0, 0, 0, 0, 0} (c) {3, 8, 4, 6, 10, 4} 


3.14 Deconvolution 

Given the system impulse response h[n], the response y[n] of the system to an input x[n] is simply the 
convolution of x[n\ and h[n}. Given x[n] and y[n\ instead, how do we find h[n\l This situation arises very 
often in practice and is referred to as deconvolution or system identification. 

For discrete-time systems, we have a partial solution to this problem. Since discrete convolution may 
be thought of as polynomial multiplication, discrete deconvolution may be regarded as polynomial division. 
One approach to discrete deconvolution is to use the idea of long division, a familiar process, illustrated in 
the following example. 

3.14.1 Deconvolution By Recursion 

Deconvolution may also be recast as a recursive algorithm. The convolution 

n 

y[n\ = x[n] * h[n] = h[k\x[n — fc] (3.52) 

k -o 

when evaluated at n = 0, provides the seed value /i[0] as 

y[o] = x[oMo] Mo] = fj| (3-53) 

We now separate the term containing h[n} in the convolution relation 

n n— 1 

y[n\ = E h[k\x[n — k] = /i[n]x[0] + h[k\x[n — k] (3.54) 

k =0 k—0 
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and evaluate h[n] for successive values of n > 0 from 


'•I" 1 = ip 


y[n] — h[k\x[n — k] 


k -o 


n> 0 


(3.55) 


If all goes well, we need to evaluate h[n\ only at M — N + 1 points, where M and N are the lengths of y[n] 
and x[n], respectively. 

Naturally, problems arise if a remainder is involved. This may well happen in the presence of noise, 
which could modify the values in the output sequence even slightly. In other words, the approach is quite 
susceptible to noise or roundoff error and not very practical. 



REVIEW PANEL 3.22 


Deconvolution May Be Regarded 

as Polynomial Division or Matrix Inversion 


EXAMPLE 3.32 (Deconvolution) 

(a) (Deconvolution by Polynomial Division) 

4 4 

Consider x[n\ = {2, 5, 0, 4} and y[n] = {8, 22, 11, 31, 4, 12}. We regard these as being the 
coefficients, in descending order, of the polynomials 

x(w) = 2 w 3 + 5 w 2 + Ow + 4 y(w) = 8 w 5 + 22 w 4 + lire 3 + 31 w 2 + 4 w + 12 

The polynomial h{w) may be deconvolved out of x(w) and y(w) by performing the division y(w)/x(w): 


4w 2 + w + 3 

2 w 3 + 5 w 2 + 0 w + 4 )8'u> 5 + 22w 4 + lire 3 + 31w 2 + 4 w + 12 
8w 5 + 20w 4 + Ow 3 + 16w 2 

2 w 4 + llu; 3 + 15 w 2 + 4 w + 12 
2 w 4 + 5 w 3 + 0 w 2 + 4 w 

6 iu 3 + 15ru 2 + Ow + 12 
6w 3 + 15w 2 + Ow + 12 
0 

4 

The coefficients of the quotient polynomial describe the sequence h[n] = {4, 1, 3}. 


(b) (Deconvolution by Recursion) 

JJ. 4 

Let x[n] = {2, 5, 0, 4} and y[n] = {8, 22, 11, 31, 4, 12}. We note that x[n] is of length N = 4 and 
y[n\ is of length M = 4. So, we need only Af — N + 1 = 6 — 4 + 1 = 3 recursive evaluations to obtain 
h[n]. We compute 


Mo] = 


M°1 

Mo] 


= 4 
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Mi] = 


1 

M°] 

i 


k[21 = * 


2/[i] - MMM 1 - M 

k =0 
1 

y[ 2] - MMM 2 - M 


fc—0 


£/[l] ~ h[0\x[l\ = 

*[ 0 ] 

y[ 2 ] - M0]x[ 2] - fc[l]s[l] 
*[ 0 ] 


= 3 


As before, /i[n] = {4, 1, 3}. 


DRILL PROBLEM 3.32 


Jf 

The input x[n] = {l, 2} to an 
find the impulse response h[n\ 

Jf 

Answer: {2, —1, 3} 

Jf 

LTI system produces the output y[n] = {2, 3, 1, 6}. Use deconvolution to 


3.15 Discrete Correlation 

Correlation is a measure of similarity between two signals and is found using a process similar to convolution. 
The discrete cross-correlation (denoted **) of x[n\ and h[n\ is defined by 


OO OO 

i'xh[n] = x[n] -k-kh[n] = x[fc]/i[fc — n] = x[fc + n]/i[fc] (3.56) 

k=— oo k——oo 

OO oo 

= /i[n] **x[n] = /i[fc]x[A; — n] = /i[fc + n]x[/c] (3.57) 

k——oo k=— oo 

Some authors prefer to switch the definitions of r x h [n] and r^x [M • 

To find r x h[n), we line up the last element of h[n] with the first element of x[n] and start shifting h[n) 
past x[n], one index at a time. We sum the pointwise product of the overlapping values to generate the 
correlation at each index. This is equivalent to performing the convolution of x[n] and the folded signal 
h[—n]. The starting index of the correlation equals the sum of the starting indices of x[n] and h[—n]. 
Similarly, rh x [n\ equals the convolution of x[—n\ and h[n\, and its starting index equals the sum of the 
starting indices of x[—n] and h[n\. However, r x h[n\ does not equal r/j X [n]. The two are folded versions of 
each other and related by r x h[n] = Th x [—n]. 


| REVIEW PANEL 3.23 | 

Correlation Is the Convolution of One Signal with a Folded Version of the Other 

r x h[n] = x[n] = x[n] * h[—n] r/j X [n] = h[n] **x[n] = h[n\ *x[—n] 

Correlation length: N x + Nh — 1 Correlation sum: ^ r M = (£MM)(£MM) 
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EXAMPLE 3.33 (Discrete Autocorrelation and Cross-Correlation) 

4 4 

(a) Let x[n ] = {2, 5, 0, 4} and h[n] = {3, 1, 4}. 

4 

To find r x h[n\, we compute the convolution of x[n] and h[—n] = {4, 1, 3}- The starting index of r x h[n] 
is n = —3. We use this to set up the index array and generate the result (using the sum-by-column 
method for convolution) as follows: 


n 

-3 

-2 

-1 

0 

1 

2 

x[n ] 

2 

5 

0 

4 



iL 

4 

1 

3 





8 

20 

0 

16 





2 

5 

0 

4 





6 

15 

0 

12 

r x h[n\ 

8 

22 

11 

4 

31 

4 

12 

So, r xh [n] 

= {8, 

22, 

11, 

4 

31, 4, 

12} 



4 4 

(b) Let x[n] = {2, 5, 0, 4} and h[n] = {3, 1, 4}. 

4 

To find rhx[n\, we compute the convolution of x[— n] = {4, 0, 5, 2} and h[n\. The starting index of 
rhx[n\ is n = —2. We use this to set up the index array and generate the result (using the sum-by¬ 
column method for convolution) as follows: 


n 

-2 -1 

0 

1 

2 

3 

x[—n] 

4 0 

5 

2 



h[n] 

3 1 

4 





12 0 

15 

6 




4 

0 

5 

2 




16 

0 

20 

8 

rhx[n\ 

12 4 

4 

31 

11 

22 

8 

So, r xh [n\ 

= {12, 4, 

4 

31, 

11, 

22, 8}. 



Note that r x h[n\ and r x h[n\ are folded versions of each other with r x h[n\ = r x h{—n\. 


4 

(c) Let x[n ] = {3, 1, -4}. 

4 

To find r xx [n], we compute the convolution of x[n) and a ;[—n] = {—4, 1, 3}- The starting index of r xx [n] 
is n = —2. We use this to set up the index array and generate the result (using the sum-by-column 
method for convolution) as follows: 
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n 

—2 

-1 

0 

1 

2 

x [n] 

3 

1 

-4 



x\—n] 

—4 

1 

3 




-12 

-4 

16 





3 

1 

-4 





9 

3 

-12 

r xx [n] 

-12 

-1 

4 

26 

-1 

-12 


So, r xx [n] = {—12, —1, 26, —1, —12}. Note that r xx [n] is even symmetric about the origin n = 0. 


DRILL PROBLEM 3.33 


4 

Let x[n] = {2, 1, 3} and h[n] 

4 

Answers: {2, —3, 7, —3, 9} 

4 

= {3, -2, 1}. Find r x h[n\, r hx [n], r xx [n] and r hh [n] 

{9, -3, 7, -3, 2} {6, 5, 14, 5, 6} {3, -8, 14, -8, 3} 


3.15.1 Autocorrelation 


The correlation r xx [n ] of a signal x\n\ with itself is called the autocorrelation. It is an even symmetric 
function (r xx [n] = r xx [—n]) with a maximum at n = 0 and satisfies the inequality |r ;ra [?r]| < r xa ,[0]. 

Correlation is an effective method of detecting signals buried in noise. Noise is essentially uncorrelated 
with the signal. This means that if we correlate a noisy signal with itself, the correlation will be due only to 
the signal (if present) and will exhibit a sharp peak at n = 0. 


| REVIEW PANEL 3.24 | 

The Autocorrelation Is Always Even Symmetric with a Maximum at the Origin 

r xx [n] = x[n] **x[n] = x[n] *x[-n] r xx [n\ = r xx [-n\ r xx [n ] < r xx [ 0] 


EXAMPLE 3.34 (Discrete Autocorrelation and Cross-Correlation) 

(a) Let x[n] = (0.5)"w[n] and h[n] = (0.4)”w[n]. We compute the cross-correlation r x h[n\ as follows: 

OO OO 

r x h[n] = x[k]h[k — n] = (0.5) fc (0.4) fe - n w[£;]w[/c — n] 

k =—oo k =—oo 


This summation requires evaluation over two ranges of n. If n < 0, the shifted step u[k — n] is nonzero 
for some k < 0. But since u[k] = 0, k < 0, the lower limit on the summation reduces to k = 0 and we 
get 


(n < 0) 


r xh [n) = ^(0.5) fc (0.4) fc - = (0.4)"" ^(0.2) fe 

k =0 k =0 


(0.4)-" 
1 - 0.2 


1.25(0.4)-"u[—n- 1] 


If n > 0, the shifted step u[k — n] is zero for k < n, the lower limit on the summation reduces to k = n 
and we obtain 

OO 

(n>0) r x h[n] = ^^(0.5) fc (0.4) fc_n 

k—n 
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With the change of variable ?n = fc — n, we get 

OO 

(n>0) r xh [n\= ^ (0.5) m+n (0.4) m 

m—0 


(0.5)” ^(0.2) m 

m—0 


(0.5)” 

1 - 0.2 


1.25(0.5)”u[n] 


So, r xh [n\ = 1.25(0.4) - ”u[—n — 1] + 1.25(0.5)"«[n]. 


(b) Let x[n] = a"rt[n], |a| < 1. To compute r xx [n ] which is even symmetric, we need compute the result 
only for n > 0 and create its even extension. Following the previous part, we have. 


(n > 0) r xx [n ] = ^ x[k\x[k — n) = ^ a k a k ” = ^ a m+n a m = a n ^ 


a 2m = 


k=—c 


k—r 


m =0 


m—0 


1 — 0 ? 


-u\n\ 


The even extension of this result gives r xx [?r] = 




1 — a 


2 ' 


(c) Let x[n ] = a n u[n ], |a| < 1, and y[n] = rect(n/21V). To find r xy [n], we shift y[k ] and sum the products 
over different ranges. Since y[k — n] shifts the pulse to the right over the limits (-N + n, N + n), the 
correlation r xy [n} equals zero until n = —N. We then obtain 

00 N + 1 i _ a N+n+l 

—N < n < N — 1 (partial overlap): r xy [n] = ^ x[k]y[k — n] = ^ a k = --- 

k— —oo k—0 

N+l 2N ^ _ n 2N+1 

n> N (total overlap): r xy [n] = ^ a k = ^ a m ~ N+1 = a^ w+1 ———-— 

k-—N-\-l m—0 ^ 


DRILL PROBLEM 3.34 | 

(a) Let x[n ] = (0.5)"u[n] and h[n] = u[n]. Find their correlation. 

(b) Let x[ri\ = (0.5)”u[n] and h,[n] = (0.5)“”u[—n]. Find their correlation. 

Answers: (a) 2u{—n — 1] + 2(0.5)"u[n] (b) {n + l)(0.5)”]rt[n] 


3.15.2 Periodic Discrete Correlation 

For periodic sequences with identical period N, the periodic discrete correlation is defined as 


N-l N-l 

r x h P [n\ = x[n]®®h[n ] = x[k]h[k — n ] rh xp [n\ = ft.[?r]©@x[n] = h[k]x[k — n] (3.58) 

k =0 fc=o 

As with discrete periodic convolution, an averaging factor of 1/A is sometimes included in the summation. We 
can find one period of the periodic correlation r x h p [n] by first computing the linear correlation of one period 
segments and then wrapping around the result. We find that Th xp [n ] is a circularly folded version of r x h P [n] 
with rh xp [n\ = r x h P [—n\. We also find that the periodic autocorrelation r xxp [n] or rhh P [n\ always displays 
circular even symmetry. This means that the periodic extension of r xxp [n\ or rhh P [n] is even symmetric about 
the origin n = 0. The periodic autocorrelation function also attains a maximum at n = 0. 
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EXAMPLE 3.35 (Discrete Periodic Autocorrelation and Cross-Correlation) 

4 4 

Consider two periodic signals whose first period is given by X\[n] = {2, 5, 0, 4} and hi[n } = {3, 1, —1, 2}. 

(a) To find the periodic cross-correlation r x h p [n\, we first evaluate the linear cross-correlation 

r xh [n}= x 1 [n]-kh 1 [-n} = {A, 8, -3, 19, 11, 4, 12} 

4 

Wraparound gives the periodic cross-correlation as r x h p = {15, 12, 9, 19}. 

4 

We invoke periodicity and describe the result in terms of its first period as r x h p = {19, 15, 12, 9}. 


(b) To find the periodic cross-correlation rh xp [n ], we first evaluate the linear cross-correlation 

rhx[n ] = r xh [-n] = {12, 4, 11, 19, -3, 8, 4} 

4 

Wraparound gives the periodic cross-correlation as rh xp = {9, 12, 15, 19}. 

4 

We rewrite the result in terms of its first period as r> ixp = {19, 9, 12, 15}. 

Note that rh xp [n] is a circularly folded version of r x h p [n\ with Th xp [n} = f x h p [—n\ 


(c) To find the periodic autocorrelation r xxp [n] , we first evaluate the linear autocorrelation 

r X x[n] = £i[n] -kx\[-n] = {8, 20, 10, 45, 10, 20, 8} 

4 

Wraparound gives the periodic autocorrelation as r xxp = {18, 40, 18, 45}. 

4 

We rewrite the result in terms of its first period as Th xp = {45, 18, 40, 18}. 

This displays circular even symmetry (its periodic extension is even symmetric about the origin n = 0). 


(d) To find the periodic autocorrelation r^hp [ n ], we first evaluate the linear autocorrelation 

rhh[n] = hi[n] *hi[-n] = {6, -1, 0, 15, 0, -1, 6} 

4 

Wraparound gives the periodic autocorrelation as r xxp = {6, —2, 6, 15}. 

4 

We rewrite the result in terms of its first period as rp xp = {15, 6, —2, 6}. 

This displays circular even symmetry (its periodic extension is even symmetric about n = 0). 
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DRILL PROBLEM 3.35 

Jf 

Let X\[n] = {2, —1, 0, 3} and h \ [n] = {1, 0, 3, 2} describe one-period segments of two periodic signals. 
Find the first period of r xxp [n ], r hhp [n ], r xhp [n] and r hxp [n\ 

Answers: {14, 4, -6, 4} {14, 8, 6, 8} {0, 8, 12, 4} {0, 4, 12, 8} 


3.15.3 Matched Filtering and Target Ranging 

Correlation finds widespread use in applications such as target ranging and estimation of periodic signals 
buried in noise. For target ranging, a sampled interrogating signal x\n\ is transmitted toward the target. 
The signal reflected from the target is s [n] = ax[n — D] + p[n], a delayed (by D) and attenuated (by a) 
version of x[n], contaminated by noise p[n\. The reflected signal s[?i] is correlated with the interrogating 
signal x[n]. If the noise is uncorrelated with the signal x[n], its correlation with x[n\ is essentially zero. The 
correlation of x[n) and its delayed version ax[n — D] yield a result that attains a peak at n = D. It is thus 
quite easy to identify the index D from the correlation peak (rather than from the reflected signal directly), 
even in the presence of noise. The (round-trip) delay index D may then be related to the target distance d 
by d = 0.5 vD/S, where v is the propagation velocity and S is the rate at which the signal is sampled. The 
device that performs the correlation of the received signal s[n] and x[n] is called a correlation receiver. 
The correlation of s[n] with x\n] is equivalent to the convolution of s[?r] with x[—n], a folded version of the 
interrogating signal. This means that the impulse response of the correlation receiver is h[n] = x[— n] and is 
matched to the transmitted signal. For this reason, such a receiver is also called a matched filter. 

Figure 3.9 illustrates the concept of matched filtering. The transmitted signal is a rectangular pulse. 
The impulse response of the matched filter is its folded version and is noncausal. In an ideal situation, the 
received signal is simply a delayed version of the transmitted signal and the output of the matched filter 
yields a peak whose location gives the delay. This can also be identified from the ideal received signal itself. 
In practice, the received signal is contaminated by noise and it is difficult to identify where the delayed pulse 
is located. The output of the matched filter, however, provides a clear indication of the delay even for low 
signal-to-noise ratios. 

Correlation also finds application in pattern recognition. For example, if we need to establish whether 
an unknown pattern belongs to one of several known patterns or templates, it can be compared (correlated) 
with each template in turn. A match occurs if the autocorrelation of the template matches (or resembles) 
the cross-correlation of the template and the unknown pattern. 


Identifying Periodic Signals in Noise 

Correlation methods may also be used to identify the presence of a periodic signal x[n ] buried in the noisy 
signal s[n] = x[n ] +p[n\ 1 where p[n\ is the noise component (presumably uncorrelated with the signal), and to 
extract the signal itself. The idea is to first identify the period of the signal from the periodic autocorrelation 
of the noisy signal. If the noisy signal contains a periodic component, the autocorrelation will show peaks 
at multiples of the period N. Once the period N is established, we can recover x[n\ as the periodic cross¬ 
correlation of an impulse train i[n] = 5(n — kN), with period N, and the noisy signal s[n]. Since i[n\ is 
uncorrelated with the noise, the periodic cross-correlation of i [n] and s[?r] yields (an amplitude scaled version 
of) the periodic signal x[n}. 

Figure 3.10 illustrates the concept of identifying a periodic signal hidden in noise. A periodic sawtooth 
signal is contaminated by noise to yield a noisy signal. The peaks in the periodic autocorrelation of the 
noisy signal allows us to identify the period as N = 20. The periodic cross-correlation of the noisy signal 
with the impulse train S[n — 20 k\ extracts the signal from noise. Note that longer lengths of the noisy signal 
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(a) Transmitted signal 




0 50 100 150 200 

(e) Noisy received signal 



-2 


0 50 100 150 200 



-20 0 50 100 150 200 


(d) Ideal matched filter output 



0 50 100 150 200 

(f) Actual matched filter output. SNR = 40 dB 



0 50 100 150 200 


Figure 3.9 The concept of matched filtering and target ranging 


(compared to the period TV) will improve the match between the recovered and buried periodic signal. 


| REVIEW PANEL 3.25 | 

How to Identify a Periodic Signal x[n] Buried in a Noisy Signal s[n] 

Find the period N of x[n\ from the periodic autocorrelation of the noisy signal s[n]. 

Find the signal x\n] as the periodic cross-correlation of s[n] and an impulse train with period N. 


3.16 Discrete Convolution and Transform Methods 

Discrete-time convolution provides a connection between the time-domain and frequency-domain methods 
of system analysis for discrete-time signals. It forms the basis for every transform method described in this 
text, and its role in linking the time domain and the transformed domain is intimately tied to the concept 
of discrete eigensignals and eigenvalues. The everlasting exponential z n is an eigensignal of discrete-time 
linear systems. In this complex exponential z n , the quantity z has the general form 2 = rel 2nF . If the input 
to an LTI system is 2 " the output has the same form and is given by Cz n where C is a (possibly complex) 
constant. Similarly, the everlasting discrete-time harmonic 2 = e j27rriF (a special case with r = 1) is also an 
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0 20 40 60 

(c) Correlation of noisy signal gives period 



0 20 40 60 


(b) Periodic signal with added noise 



0 20 40 60 



0 20 40 60 


Figure 3.10 Extraction of a periodic signal buried in noise 


eigensignal of discrete-time systems. 

3.16.1 The z-Transform 

For an input x[n] = r n e^ 27rnF = (re- j27rF ) n = z n , where z is complex, with magnitude |z| = r, the response 
may be written as 

oo oo 

■y[n] = x[n] * h[n] = E z n ~ k h[k] = z n E h[k\z~ k = x[n\H{z) (3.59) 

k=— oo k=— oo 

The response equals the input (eigensignal) modified by the system function H(z), where 

OO 

H{z)= E h[k\z k (two-sided z-transform) (3.60) 

k=— oo 

The complex quantity H(z) describes the z-transform of h[n\ and is not, in general, periodic in z. Denoting 
the z-transform of x[n] and y[n] by X(z) and F(z), we write 

OO OO 

T(z)= E y[k\z~ k = E x[k\H{z)z~ k = H{z)X{z) (3.61) 

k=— oo k=— oo 

Convolution in the time domain thus corresponds to multiplication in the z-domain. 
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3.16.2 The Discrete-Time Fourier Transform 

For the harmonic input x[n] = e^ 2 '"" nF , the response y[n\ equals 

oo oo 

y[n]= J2 e j2 < n - k)F h[k\ = e j2 ™ F h[k\e~ j27rkF = x[n]H(F) (3.62) 

k=— oo k——oo 

This is just the input modified by the system function H(F), where 

OO 

H(F) = h[k\e~ j2 * kF (3.63) 

k=— oo 

The quantity H(F) describes the discrete-time Fourier transform (DTFT) or discrete-time frequency 
response or spectrum of h[n\. Any signal x [n] may similarly be described by its DTFT X(F). The response 
y[n] = x[n]H[F] may then be transformed to its DTFT Y[n] to give 

OO OO 

Y(F) = y[k)e- j2 * Fk = x[k]H(F)e~ j27rFk = H{F)X(F ) (3.64) 

k=— oo k=— oo 

Once again, convolution in the time domain corresponds to multiplication in the frequency domain. Note 
that we obtain the DTFT of h[n] from its 2 -transform H{z) by letting 2 = e^ 2lTF or \z\ = 1 to give 

H{F) = H(z)\ z=expU2 „ F) = H{z) | N= i (3.65) 

The DTFT is thus the 2 -transform evaluated on the unit circle \z\ = 1. The system function H(F) is also 
periodic in F with a period of unity because e~^ 2nkF — e -J 27rfc ( ir + 1 ). This periodicity is a direct consequence 
of the discrete nature of h [n]. 
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CHAPTER 3 PROBLEMS 


3.1 (Operators) Which of the following describe linear operators? 

( a ) 0 { } = 4{ } (b)0{} = 4{} + 3 (c )0{} = aO 

3.2 (System Classification) In each of the systems below, x[n] is the input and y[n\ is the output. 
Check each system for linearity, shift invariance, memory, and causality. 

(a) y[n] — y[n — 1] = x[n] (b) y[n] + y[n + 1] = nx[n\ 

(c) y[n] — y[n + 1] = x[n + 2] (d) y[n + 2] — y[n + 1] = x[n] 

(e) y[n + 1] — x[n]?/[n] = nx[n + 2] (f) y[n\ + y[n — 3] = x 2 [n\ + x[n + 6] 

(g) V N — 2 n y[n] = x[n] (h) y[n] = x[n] + x[n — 1] + x[n — 2] 

3.3 (System Classification) Classify the following systems in terms of their linearity, time invariance, 
memory, causality, and stability. 

(a) y[n] = 3 n x[n] (b) y[n ] = e? n,r a :[n] 

(c) y[n] = cos(0.5?r7r)a;[?r] (d) y[n ] = [1 + cos(0.5?r7r)]x[?r] 

(e) y[n] = e x ^ (f) y[n ] = x[n ] + cos[0.5(?i + l)7r] 

3.4 (System Classification) Classify the following systems in terms of their linearity, time invariance, 
memory, causality, and stability. 

(a) y[n] = x[n/ 3] (zero interpolation) 

(b) y[n] = cos(n7r)x[?r] (modulation) 

(c) y[n] = [1 + cos(n7r)]a;[n] (modulation) 

(d) y[n] = cos(n7rx[?r]) (frequency modulation) 

(e) y[n] = cos(n7r + x[n}) (phase modulation) 

(f) y[n] = x[n] — x[n — 1] (differencing operation) 

(g) y[n] = 0.5cc[n] + 0.5 x[n — 1] (averaging operation) 

JV-l 

(h) y[n] = ^ x[n — k] (moving average) 

k —0 

(i) y[n] — ay[n — 1] = ax[n], 0 < a < 1 (exponential averaging) 

0) y[n] = 0.4 (y[n - 1] + 2) + x[n} 

3.5 (Classification) Classify each system in terms of its linearity, time invariance, memory, causality, 
and stability. 

(a) The folding system y[n] = x[—n]. 

(b) The decimating system y[n\ = x[2n]. 

(c) The zero-interpolating system y[n] = x[n/ 2]. 

(d) The sign-inversion system y[n] = sgn{x[?r]}. 

(e) The rectifying system y[n] = \x[n\\. 

3.6 (Classification) Classify each system in terms of its linearity, time invariance, causality, and stability. 

(a) y[n\ = round{a;[n]} (b) y[n\ = median{x[?i + 1], x[n], x[n — 1]} 

(c) y[n\ = a;[n]sgn(?i) (d) y[n\ = x[n] sgn{a;[n]} 
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3.7 (Realization) Find the difference equation for each system realization shown in Figure P3.7. 



Figure P3.7 Filter realizations for Problem 3.7 


[Hints and Suggestions: Compare with the generic first-order and second-order realizations to get 
the difference equations.] 

3.8 (Response by Recursion) Use recursion to find the response y[n) of the following systems for the 
first few values of n and discern the general form for y[n\. 

(a) y[n] - ay[n - 1] = 6[n] y[- 1] = 0 

(b) y[n] - ay[n - 1] = u[n\ y[- 1] = 1 

(c) y[n] - ay[n - 1] = u[n] y[- 1] = 1 

(d) y[n] — ay[n — 1] = nu[n ] j/[—1] = 0 

[Hints and Suggestions: For parts (b)-(d), you may need to use a table of summations to simplify 
the results for the general form.] 

3.9 (Response by Recursion) Let y[n\ + 4 y[n — 1] + 3 y[n — 2] = u[n — 2] with y[— 1] = 0, y[— 2] = 1. 
Use recursion to compute y[n] up to n = 4. Can you discern a general form for y[n}7 

3.10 (Forced Response) Find the forced response of the following systems. 

(a) y[n] — QAy[n — 1] = 3 u[n\ (b) y[n) — 0Ay[n — 1] = (0.5)" 

(c) y[n] + 0Ay[n — 1] = (0.5)" (d) y[n] — 0.5 y[n — 1] = cos(n7r/2) 

[Hints and Suggestions: For part (a), 3u[n] = 3, n > 0 and implies that the forced response 
(or its shifted version) is constant. So, choose 2 /fN = C = yp[n — 1]. For part (c), pick j/p[n] = 
Acos(0.5n7r) + B sin(0.5n7r), expand terms like cos[0.5(n — l)7r] using trigonometric identities and 
compare the coefficients of cos(0.5n7r) and sin(0.5n7r) to generate two equations to solve for A and B] 

3.11 (Zero-State Response) Find the zero-state response of the following systems. 

(a) y[n] — 0.5 y[n — 1] = 2 u[n] (b) y[n ] — 0.4y[n — 1] = (0.5)"u[n] 

(c) y[n] — 0Ay[n — 1] = (0.4)"u[n] (d) y[n ] — 0.5 y[n — 1] = cos(n7r/2) 

[Hints and Suggestions: Here, zero-state implies z/[— 1] = 0. Part (c) requires j/f[n] = Cn( 0.5)" 
because the root of the characteristic equation is O.5.] 

3.12 (Zero-State Response) Consider the system y[n] — 0.5 y[n — 1] = x[n\. Find its zero-state response 
to the following inputs. 

(a) x[n] = u[n\ (b) x[n ] = (0.5)"n[n] (c) x[n] = cos(0.5n7r)n[?r] 

(d) x[n\ = (—l)"w[n] (e) x[n} = j n u[n} (f) x[n] = (Vj) n u[n] + (VJ )~ n u[n\ 

[Hints and Suggestions: For part (e), pick the forced response as j/j?[n] = C(j) n . This will give 
a complex response because the input is complex. For part (f), x[n ] simplifies to a sinusoid by using 
\Jj = and Euler’s relation.] 
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3.13 (Zero-State Response) Find the zero-state response of the following systems. 

(a) y[n] — 1.1 y[n — 1] + 0.3 y[n — 2] = 2 u[n] (b) y[n) + 0.7 y[n — 1] + 0.1 y[n — 2] = (0.5)" 

(c) y[n] — 0.9j/[?i — 1] + 0.2 y[n — 2] = (0.5)" (d) y\n) — 0.25y[n — 2] = cos(n7r/2) 

[Hints and Suggestions: Zero-state implies y[— 1] = y[— 2] = 0. For part (b), use ?/f[u] = C(0.5)", 
but for part (c), pick j/jr[n] = Cn( 0.5)" because one root of the characteristic equation is O.5.] 

3.14 (System Response) Let y[n\ —0.5 y[n— 1] = x[n], with y[— 1] = —1. Find the response of this system 
due to the following inputs for n > 0. 

(a) x[n ] = 2 u[n} (b) x[n ] = (0.25)"w[n] (c) x[n} = ?r(0.25)"it[?r] 

(d) x[n ] = (0.5)"w[n] (e) x[n] = n(0.5)"u[n] (f) x[n] = (0.5)" cos(0.5n7r)ii[u] 

[Hints and Suggestions: For part (c), pick ?/fM = (C + D?i)(0.5)" (and compare coefficients of 
like powers of n to solve for C and D). For part (d), pick j/jr[n] = Cn(0.5)" because the root of the 
characteristic equation is 0.5. Part(e) requires j/f[u] = n(C + Dn) (0.5)" for the same reason.] 

3.15 (System Response) For the system realization shown in Figure P3.15, find the response to the 
following inputs and initial conditions. 

(a) x[n} = u[n} ?/[—1] = 0 (b) x[n} = u[n ] ?/[—1] = 4 

(c) x[n} = (0.5)"u[n] ?/[—1] = 0 (d) x[n] = (0.5)"w[n] y[— 1] = 6 

(e) x[n} = (—0.5)"u[n] y[— 1] = 0 (f) x[n} = (—0.5)"u[n] y[— 1] = —2 



Figure P3.15 System realization for Problem 3.15 
[Hints and Suggestions: For part (e), pick the forced response as y f [u] = Cn(— 0.5)".] 

3.16 (System Response) Find the response of the following systems. 

(a) y[n] — 0Ay[n — 1] = 2(0.5) n_1 u[n — 1] y[—1] = 0 

(b) y[n\ - 0Ay[n - 1] = (0.4)"u[n] + 2(0.5)"" 1 u[n - 1] y[- 1] = 2.5 

(c) y[n\ - 0Ay[n - 1] = n(0.5)"u[n] + 2(0.5)"- 1 u[?r - 1] y[- 1] = 2.5 

[Hints and Suggestions: Start with y[n] — 0Ay[n — 1] = 2(0.5)", y[— 1] = 0 and find its zero-state 
response. Then use superposition and time invariance as required. For the input (0.4)" of part (b), 
assume j/fH = Cn(0.4)". For the input n(0.5)" of part (c), assume j/f[tj] = (A + £?n)(0.5)".] 

3.17 (System Response) Find the impulse response of the following filters. 

(a) y[n] = x[n] — x[n — 1] (differencing operation) 

(b) y[n] = 0.5cc[?r] + 0.5 x[n — 1] (averaging operation) 

JV-l 

(c) y[n] = jj x[n — k], N = 3 (moving average) 

fc=o 

JV-l 

(d) y[n] = N ( N+1 j E ( N — k)x[n — k], N = 3 (weighted moving average) 

k =0 

(e) y[n] — ay[n — 1] = (1 — a)x[n], N = 3, a = (exponential averaging) 
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3.18 (System Response) It is known that the response of the system y[n] + ay[n — 1] = x[n], a ^ 0, is 
given by y[n] = [5 + 3(0.5) n ]u[n]. 

(a) Identify the natural response and forced response. 

(b) Identify the values of a and y[— 1]. 

(c) Identify the zero-input response and zero-state response. 

(d) Identify the input x[n}. 

3.19 (System Response) It is known that the response of the system y\n]+0.5y\n —11 = x\n] is described 
by y[n] = [5(0.5) n + 3(—0.5)")]w[n]. 

(a) Identify the zero-input response and zero-state response. 

(b) What is the zero-input response of the system y[n] + 0.5 y[n — 1] = x\n ] if y{— 1] = 10? 

(c) What is the response of the relaxed system y[n] + 0.5 y[n — 1] = x[n — 2]? 

(d) What is the response of the relaxed system y[n} + 0.5 y[n — 1] = x[n — 1] + 2x[n\? 

3.20 (System Response) It is known that the response of the system y\n] + ay\n — 11 = x\n] is described 
by y[n] = (5 + 2n)(0.5) n u[n]. 

(a) Identify the zero-input response and zero-state response. 

(b) What is the zero-input response of the system y[n] + ay[n — 1] = x[n] if y{— 1] = 10? 

(c) What is the response of the relaxed system y[n] + ay[n — 1] = x[n — 1])? 

(d) What is the response of the relaxed system y[n} + ay[n — 1] = 2 x[n — 1] + a;[n]? 

(e) What is the complete response of the y[n ] + ay[n — 1] = x[n] + 2 x[n — 1] if j/[—1] = 4? 

3.21 (System Response) Find the response of the following systems. 

(a) y[n] + 0.1y[?r — 1] — 0.3 y[n — 2] = 2 u[n] y[— 1] = 0 y[— 2] = 0 

(b) y[n] — 0.9y[n — 1] + 0.2y[n — 2] = (0.5) n y[- 1] = 1 y[- 2] =-4 

(c) y[n]+0.7y[n-l]+0.1y[n-2] = (0.5) n y[-l) = 0 y[- 2] = 3 

(d) y[n] - 0.25y[n - 2] = (0.4)" y[-l] = 0 y[- 2] = 3 

(e) y[n] - 0.25 y[n - 2] = (0.5)- y[-l] = 0 y[- 2] = 0 

[Hints and Suggestions: For parts (b) and (e), pick yF[n\ = Cn( 0.5)" because one root of the 
characteristic equation is O.5.] 

3.22 (System Response) Sketch a realization for each system, assuming zero initial conditions. Then 
evaluate the complete response from the information given. Check your answer by computing the first 
few values by recursion. 

(a) y[n] — 0Ay[n — 1] = x[n] x[n] = (0.5) n w[?r] ?/[—1] = 0 

(b) y[n] — 0Ay[n — 1] = 2 x[n] + x[n — 1] x[n} = (0.5) n w[?r] j/[—1] = 0 

(c) y[n] — 0Ay[n — 1] = 2 x[n] + x[n — 1] x[n] = (0.5) n M[?rj j/[—1] = 5 

(d) y[n] + 0.5y[n — 1] = x[n] — x[n — 1] x[n] = (0.5)"u[?rj y[— 1] = 2 

(e) y[n] + 0.5y[n — 1] = x[n] — x[n — 1] x[it\ = (—0.5) ra w[n] y[— 1] = 0 

[Hints and Suggestions: For parts (b)-(c), use the results of part (a) plus linearity (superposition) 
and time invariance.] 

3.23 (System Response) For each system, evaluate the natural, forced, and total response. Assume that 
y[— 1] = 0,y[—2] = 1. Check your answer for the total response by computing its first few values by 
recursion. 
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(a) y[n] + 4 y[n — 1] + 3 y[n — 2] = u[n\ (b) {1 — 0.5 z~ 1 }y[n] = (0.5) n cos(0.5n7r)u[n] 

(c) y[n] + 4 y[n — 1] + 8 y[n — 2] = cos(n7r)u[n] (d) {(1 + 2 z~ 1 ) 2 }y[n] = n(2) n u[n] 

(e) {1 + 1 2 _1 + | z~ 2 }y[n] = (|) n u[n] (f) {1 + 0.5z _1 + 0.25z~ 2 }y[n] = cos(0.5n7r)u[n] 

[Hints and Suggestions: For part (b), pick i/pjn] = (0.5)"[Acos(0.5?r7r) + B sin(0.5n7r)], expand 

terms like cos[0.5(n — l)7r] using trigonometric identities and compare the coefficients of cos(0.5?r7r) 
and sin(0.5ri7r) to generate two equations to solve for A and B. For part (d), pick yF[n] = (C+Dn)(2) n 
and compare like powers of n to solve for C and D.} 

3.24 (System Response) For each system, evaluate the zero-state, zero-input, and total response. Assume 
that y[—1] = 0, j/[—2] = 1. 

(a) y[n] + 4 y[n — 1] + 4 y[n — 2] = 2 n u[n\ (b) {z 2 + 4z + 4 }y[n\ = 2 n u[n\ 

[Hints and Suggestions: In part (b), y[n + 2] + 4 y[n + 1] + 4y[n] = (2 ) n u[n\. By time invariance, 
y[n] + 4 y[n — 1] + 4 y[n — 2] = (2) n_2 u[n — 2] and we shift the zero-state response of part (a) by 2 units 
(n —> n — 2) and add to the zero-input response to get the result.] 

3.25 (System Response) For each system, set up a difference equation and compute the zero-state, 
zero-input, and total response, assuming x[n] = u[n] and y[— 1] = y[— 2] = 1. 

(a) {1 — z _1 — 2z~ 2 }y[n] = x[n\ (b) { z 2 — z — 2 }y[n\ = x[n\ 

(c) {1 - Iz- 1 + \z- 2 }y[n] = x[n] (d) {1 - \z~' + § z~ 2 }y[n] = {1 + z~'}x[n\ 

(e) {1 — 0.252; 2 }y[n ] = x[n] (f) {z 2 — 0.25}y[n] = {2 z 2 + l}x[n] 

[Hints and Suggestions: For part (b), use the result of part (a) and time-invariance to get the answer 
as y za [n — 2] + y zl [n ]. For part (d), use the result of part (c) to get the answer as yzi[n] + y zs [n\+y zs [n — 1], 
The answer for part (f) may be similarly obtained from part (e).] 

3.26 (Impulse Response by Recursion) Find the impulse response h[n] by recursion up to n = 1 for 
each of the following systems. 

(a) y[n] — y[n — 1] = 2 x[n] (b) y[n] — 3 y[n — 1] + 6 y[n — 2] = x[n — 1] 

(c) y[n] — 2y[n — 3] = x[n — 1] (d) y[n] — y[n — 1] + 6 y[n — 2] = nx[n — 1] + 2 x[n — 3] 

[Hints and Suggestions: For the impulse response, x[n] = 1, n = 0 and x[n] = 0, n / 0.] 

3.27 (Analytical Form for Impulse Response) Classify each filter as recursive or FIR (nonrecursive), 
and causal or noncausal, and find an expression for its impulse response h[n\. 

(a) y[n] = x[n] + x[n — 1] + x[n — 2] (b) y[n ] = x[n + 1] + x[n ] + x[n — 1] 

(c) y[n] + 2y[n — 1] = x[n ] (d) y[n} + 2y[n — 1] = x[n — 1] 

(e) y[n] + 2 y[n — 1] = 2 x\n\ + 6 x[n — 1] (f) y[n ] + 2 y[n — 1] = x[n + 1] + 4a :[n\ + 6a;[n — 1] 

(g) {1 + 4z -1 + 3 z~ 2 }y[n] = {z~ 2 }x[n] (h) {z 2 + 4 z + 4}y[n] = {z + 3}a;[?r] 

(i) {z 2 +4 z + 8}y[n] = a;[n] (j) y[n] + 4y[n — 1] + 4 y[n — 2] = x[n] — x[n + 2] 

[Hints and Suggestions: To find the impulse response for the recursive filters, assume y[0] = 1 and 
(if required) a/[—1] = y[— 2] = • • • = 0. If the right hand side of the recursive filter equation is anything 
but x[n], start with the single input x[n] and then use superposition and time-invariance to get the 
result for the required input. The results for (d)-(f) can be found from the results of (c) in this way.] 

3.28 (Stability) Investigate the causality and stability of the following right-sided systems. 

(a) y[n] = x[n — 1] + x[n\ + x[n + 1] (b) y[n] = x[n\ + x[n — 1] + a:[n — 2] 

(c) y[n] — 2 y[n — 1] = a;[n] (d) y[n] — 0.2 y[n — 1] = x[n] — 2x[n + 2] 

(e) y[n\ + y[n — 1] + 0.5 y[n — 2] = x[n\ (f) y[n\ — y[n — 1] + y[n — 2] = x[n\ — a;[n + 1] 

(g) V W — 2 y[n — 1] + y[n — 2] = a;[?r] — a;[n — 3] (h) y[n] — 3 y[n — 1] + 2 y[n — 2] = 2x[n + 3] 
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[Hints and Suggestions: Remember that FIR filters are always stable and for right-sided systems, 
every root of the caracteristic equation must have a magnitude (absolute value) less than 1.] 

3.29 (System Interconnections) Two systems are said to be in cascade if the output of the first system 
acts as the input to the second. Find the response of the following cascaded systems if the input is a 
unit step and the systems are described as follows. In which instances does the response differ when the 
order of cascading is reversed? Can you use this result to justify that the order in which the systems 
are cascaded does not matter in finding the overall response if both systems are LTI? 

(a) System 1: y[n] = x[n] — x[n — 1] System 2: y[n] = 0.5 y[n — 1] + x[n] 

(b) System 1: y[n] = 0.5 y[n — 1] + x[n] System 2: y[n] = x[n] — x[n — 1] 

(c) System 1: y[n] = x 2 [n ] System 2: y[n] = 0.5 y[n — 1] + x[n] 

(d) System 1: y[n] = 0.5 y[n — 1] + x[n] System 2: y[n] = x 2 [n ] 

3.30 (Systems in Cascade and Parallel) Consider the realization of Figure P3.30. 



Figure P3.30 System realization for Problem 3.30 


(a) Find its impulse response if a//9. Is the overall system FIR or HR? 

(b) Find its difference equation and impulse response if a = (3. Is the overall system FIR or HR? 

(c) Find its difference equation and impulse response if a = (3 = 1. What is the function of the 
overall system? 

3.31 (Difference Equations from Impulse Response) Find the difference equations describing the 
following systems. 

(a) h[n\ = (5[n] + 2 6[n — 1] (b) h[n] = {2, 3, —1} 

(c) h[n ] = (0.3)™u[n] (d) h[n] = (0.5)"u[n] — (—0.5)"u[n] 

[Hints and Suggestions: For part (c), the left hand side of the difference equation is y[n] — 0.3y[n— 1]. 
So, h[n] — 0.3 h[n — 1] simplified to get impulses leads to the right hand side. For part (d), start with 
the left hand side as y[n] — 0.25 y[n — 2].] 

3.32 (Difference Equations from Impulse Response) A system is described by the impulse response 
h[n] = (—1 ) n u[n\. Find the difference equation of this system. Then find the difference equation of 
the inverse system. Does the inverse system describe an FIR filter or HR filter? What function does 
it perform? 

3.33 (Difference Equations) For the filter realization shown in Figure P3.33, find the difference equation 
relating y[n\ and x[n ] if the impulse response of the filter is given by 

(a) h[n] = i5[?r] — 5{n — 1] (b) h[n] = 0.5<5[?r] + 0.5<5[n — 1] 
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Figure P3.33 Filter realization for Problem 3.33 

3.34 (Difference Equations from Differential Equations) This problem assumes some familiarity 
with analog theory. Consider an analog system described by y"(t) + 3 y'(t) + 2 y(t) = 2 u(t). 

(a) Confirm that this describes a stable analog system. 

(b) Convert this to a difference equation using the backward Euler algorithm and check the stability 
of the resulting digital filter. 

(c) Convert this to a difference equation using the forward Euler algorithm and check the stability 
of the resulting digital filter. 

(d) Which algorithm is better in terms of preserving stability? Can the results be generalized to any 
arbitrary analog system? 

3.35 (Inverse Systems) Are the following systems invertible? If not, explain why; if invertible, find the 
inverse system. 

(a) y[n] = x[n\ — x[n — 1] (differencing operation) 

(b) y[n] = |(a;[n] + x[n — 1] + x[n — 2]) (moving average operation) 

(c) y[n\ = 0.5cc[?r] + x[n — 1] + 0.5a;[n — 2] (weighted moving average operation) 

(d) y[n\ — ay[n — 1] = (1 — a)a:[n\, 0 < a < 1 (exponential averaging operation) 

(e) y[n] = cos(n7r)a;[?r] (modulation) 

(f) y[n] = cos(x[n]) 

(g) y[n] = e xM 

[Hints and Suggestions: The inverse system is found by swithcing input and output and rearranging. 
Only one of these systems is not invertible.] 

3.36 (An Echo System and Its Inverse) An echo system is described by y[n\ = x[n] + 0.5x[n — N], 
Assume that the echo arrives after 1 ms and the sampling rate is 2 kHz. 

(a) What is the value of N? Sketch a realization of this echo system. 

(b) What is the impulse response and step response of this echo system? 

(c) Find the difference equation of the inverse system. Then, sketch its realization and find its 
impulse response and step response. 

3.37 (Reverb) A reverb filter is described by y[n] = x[n] + 0.25 y[n — AT]. Assume that the echoes arrive 
every millisecond and the sampling rate is 2 kHz. 

(a) What is the value of N? Sketch a realization of this reverb filter. 

(b) What is the impulse response and step response of this reverb filter? 

(c) Find the difference equation of the inverse system. Then, sketch its realization and find its 
impulse response and step response. 

3.38 (Periodic Signal Generators) Find the difference equation of a filter whose impulse response is a 

Jf 

periodic sequence with first period x[n] = {1, 2, 3, 4, 6, 7, 8}. Sketch a realization for this filter. 
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3.39 (Recursive and HR Filters) The terms recursive and IIR are not always synonymous. A recursive 
filter could in fact have a finite impulse response. Use recursion to find the the impulse response h[n] 
for each of the following recursive filters. Which filters (if any) describe HR filters? 

(a) y[n] — y[n — 1] = x[n ] — x[n — 2] 

(b) y[n] — y[n — 1] = x[n] — x[n — 1] — 2 x[n — 2] + 2 x[n — 3] 

3.40 (Recursive Forms of FIR Filters) An FIR filter may always be recast in recursive form by the 

simple expedient of including identical factors on the left-hand and right-hand side of its difference 

equation in operational form. For example, the filter y[n\ = (1 — z~ 1 )x[ji] is FIR, but the identical 
filter (1 + z~ 1 )y[n\ = (1 + 2 _1 )(1 — z~ 1 )x[n] has the difference equation y[n] +y[n— 1] = x[n] — x\n — 2] 
and can be implemented recursively. Find two different recursive difference equations (with different 
orders) for each of the following filters. 

Jf 

(a) y[n] = x[n] — x[n — 2] (b) h[n ] = {1, 2, 1} 

3.41 (Nonrecursive Forms of IIR Filters) An FIR filter may always be exactly represented in recursive 
form, but we can only approximately represent an IIR filter by an FIR filter by truncating its impulse 
response to N terms. The larger the truncation index N, the better is the approximation. Consider the 
IIR filter described by y[n\ — 0.8 y[n — 1] = x[n}. Find its impulse response h [n] and truncate it to three 
terms to obtain h^n], the impulse response of the approximate FIR equivalent. Would you expect the 
greatest mismatch in the response of the two filters to identical inputs to occur for lower or higher 
values of n? Compare the step response of the two filters up to n = 6 to justify your expectations. 

3.42 (Nonlinear Systems) One way to solve nonlinear difference equations is by recursion. Consider the 
nonlinear difference equation y[n]y[n — 1] — 0.5 y 2 [n — 1] = 0.5 Au[n\. 

(a) What makes this system nonlinear? 

(b) Using y[— 1] = 2, recursively obtain y[0], y[l], and y[ 2 ]. 

(c) Use A = 2, A = 4, and A = 9 in the results of part (b) to confirm that this system finds the 
square root of A. 

(d) Repeat parts (b) and (c) with y[— 1] = 1 to check whether the choice of the initial condition 
affects system operation. 

3.43 (LTI Concepts and Stability) Argue that neither of the following describes an LTI system. Then, 
explain how you might check for their stability and determine which of the systems are stable. 

(a) y[n} + 2 y[n — 1] = x[n} + x 2 [n] (b) y[n] — 0.5 y[n — 1] = nx[n} + x 2 [n] 

3.44 (Response of Causal and Noncausal Systems) A difference equation may describe a causal or 
noncausal system depending on how the initial conditions are prescribed. Consider a first-order system 
governed by y[n] + ay[n — 1] = x[n}. 

(a) With y[n] = 0,?r < 0, this describes a causal system. Assume y[— 1] = 0 and find the first few 
terms j/[0],j/[ 1], ... of the impulse response and step response, using recursion, and establish the 
general form for y [n]. 

(b) With y[n] = 0,n > 0, we have a noncausal system. Assume j/[0] = 0 and rewrite the difference 
equation as y[n — 1] = {— y[n] + x[n\}/a to find the first few terms y[0], y[— 1], y[— 2],... of the 
impulse response and step response, using recursion, and establish the general form for y[n\. 
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3.45 (Folding) For each signal x[n], sketch g[k] = x[3 — k] vs. k and h[k\ = x[2 + k] vs. k. 

(a) x[n] = {1, 2, 3, 4} (b) x[n] = {3, 3, 3, 2, 2, 2} 

[Hints and Suggestions: Note that g[k] and h[k] will be plotted against the index k.] 

3.46 (Closed-Form Convolution) Find the convolution y[n] = x[n\ * h[n] for the following: 


(a) 

X 

M 

= u[n] 

h[n] - 

= u[n} 

(b) 

X 

M 

= (0.8) n u[n] 

h[n ] = 

= (0.4) n u[n] 

( c ) 

X 

M 

= (0.5) n u[n] 

h[n] - 

= (0.5)"{u[n + i 

(d) 

X 

M 

= a n u[n ] 

h[n} = 

= a n u[n\ 

(e) 

X 

[n] 

= a n u[n ] 

h[n] - 

= /3 n u[n] 

(f) 

X 

[n] 

= a n u[n ] 

h[n] -- 

= rect(n/2A r ) 


[Hints and Suggestions: The summations will be over the index k and functions of n should be 
pulled out before evaluating them using tables. For (a), (b), (d) and (e), summations will be from 
k = 0 to k = n. For part (c) and (f), use superposition. For (a) and (d), the sum E(l) fe = E(l) from 
k = 0 to k = n equals n + 1.] 

3.47 (Convolution with Impulses) Find the convolution y[n ] = x[n] * h[n\ of the following signals. 

(a) x[n ] = S[n — 1] h[n] = S[n — 1] 

(b) x[n] = cos(0.25?r7r) h[n] = c)[?r] — 5[n — 1] 

(c) x[n] = cos(0.25?r7r) h[n ] = <5|Yi] — 2 5[n — 1] + S[n — 2] 

(d) x[n ] = (— l) n h[n] = i5[?r] + 8[n — 1] 

[Hints and Suggestions: Start with <5[?r] * g[n] = g[n} and use linearity and time invariance.] 

3.48 (Convolution) Find the convolution y[n] = x[n} * h[n] for each pair of signals. 

(a) x[n ] = (0.4)“"u[n] h[n] = (0.5)“"u[n] 

(b) x[n ] = a~ n u[n] h[n ] = (3~ n u[n} 

(c) x[n] = a n u[—n] h[n ] = (3 n u[—n] 

(d) x[n ] = a~ n u[—n] h[n] = /3~ n u[—n] 

[Hints and Suggestions: For parts (a) and (b) write the exponentials in the form r n . For parts (c) 
and (d) find the convolution of x[—n\ and h[—n] and fold the result to get y[n\.} 

3.49 (Convolution of Finite Sequences) Find the convolution y[n] = x[?r]*ft.[n] for each of the following 
signal pairs. Use a marker to indicate the origin n = 0. 

(a) x[n] = {1,2,0,1} h[n\ = { 2,2,3} 

(b) x[n\ = {0,2,4,6} h[n] = {6,4,2,0} 

(c) x[n ] = {-3, -2, - 1,0,1} h[n] = {4,3,2} 

(d) *[«] = {3,2,1,1,2} h[n] = {4,2,3,2} 

(e) x[n\ = {3,0,2,0,1,0,1,0,2} h[n] = {4,0,2,0,3,0,2} 

(f) x[n] = {0,0,0,3,1,2} h[n] = {4,2,3,2} 

[Hints and Suggestions: Since the starting index of the convolution equals the sum of the starting 
indices of the sequences convolved, ignore markers during convolution and assign as the last step.] 
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3.50 (Convolution of Symmetric Sequences) The convolution of sequences that are symmetric about 
their midpoint is also endowed with symmetry (about its midpoint). Compute y[n] = x[n] * h[n] for 
each pair of signals and use the results to establish the type of symmetry (about the midpoint) in 
the convolution if the convolved signals are both even symmetric (about their midpoint), both odd 
symmetric (about their midpoint), or one of each type. 


(a) x[n] = (2, 1, 2} 

(b) x[n] = (2, 1, 2} 

(c) x[n] = (2, 2} 

(d) x[n] = (2, 0, —2} 

(e) x[n] = (2, 0, -2} 

(f) x[n] = (2, -2} 

(g) x[n] = (2, 1, 2} 

(h) x[n] = (2, 1, 2} 

(i) x[n] = (2, 2} 


h[n\ = {1, 0, 1} 
h[n] = {1, 1} 
h[n] = {1, 1} 
h[n] = {1, 0, -1} 
h[n] = {1, -1} 
h[n] = {1, -1} 
h[n\ = {1, 0, -1} 
h[n] = (1, -1} 

h[n] = {1, -1} 


3.51 (Properties) Let x[n\ = h[n] = {3,4,2,1}. Compute the following: 

(a) y[n\ = x[n] * h[n ] (b) g[n\ = x[— n] * h[—n] 

(c) p[n } = x[n] * h[—n] (d) f[n] = x[— n] * h[n) 

(e) r[n] = x[n — 1] * h[n + 1] (f) s[n] = x[n — 1] * h[n + 4] 

[Hints and Suggestions: The results for (b) and (d) can be found by folding the results for (a) and 
(c) respectively. The result for (f) can be found by shifting the result for (e) (time-invariance).] 


3.52 (Properties) Let x[vl\ = h[n] = {2,6,0,4}. Compute the following: 

(a) y[n] = x[2n] * h[2n] 

(b) Find g[n] = a:[n/2] *h[n/2], assuming zero interpolation. 

(c) Find p[n] = a;[n/2] * h[n], assuming step interpolation where necessary. 

(d) Find r[n] = x [n] *h[n/2], assuming linear interpolation where necessary. 


3.53 (Application) Consider a 2-point averaging filter whose present output equals the average of the 
present and previous input. 

(a) Set up a difference equation for this system. 

(b) What is the impulse response of this system? 

4 

(c) What is the response of this system to the sequence {l, 2,3,4,5}? 

(d) Use convolution to show that the system performs the required averaging operation. 


3.54 (Step Response) Given the impulse response h[n ], find the step response s[?r] of each system. 

(a) h[n] = (0.5)™u[n] (b) h[n] = (0.5)" cos(n7r)u[n] 

(c) h[n\ = (0.5)" cos(n7r + 0.57r)w[n] (d) h[n\ = (0.5)" cos(ri7r + 0.257r)u[n] 

(e) h[n] = n(0.5)"u[n] (f) h[n] = n(0.5)" cos(n7r)w[n] 

[Hints and Suggestions: Note that .s [n] = x[n] * h[n] where x[n\ = u[n}. In part (b) and (f), note 
that cos(n7r) = (—1)". In part (d) expand cos(?r7r + 0.257r) and use the results of parts (b).] 

3.55 (Convolution and System Response) Consider the system y[n\ — 0.5 y[n — 1] = x[n}. 

(a) What is the impulse response h[n] of this system? 

(b) Find its output if x[n} = (0.5)"u[n] by convolution. 
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(c) Find its output if x[n] = (0.5)”u[n] and y[— 1] = 0 by solving the difference equation. 

(d) Find its output if x[n] = (0.5)”w[n] and y[— 1] = 2 by solving the difference equation. 

(e) Are any of the outputs identical? Should they be? Explain. 


[Hints and Suggestions: For part (e), remember that convolution finds the zero-state response.] 

tt 

3.56 (Convolution and Interpolation) Let x[n] = {2,4, 6 , 8 }. 

(a) Find the convolution y[n\ = x[n] -kx[n]. 

(b) Find the convolution y-\ [n] = :r[2 n] *x[2n]. Is yi[n] related to y[n]l Should it be? Explain. 

(c) Find the convolution 2 / 2 M = x[n/2] * x[n/ 2], assuming zero interpolation. Is 2 / 2 H related to 
y[n\7 Should it be? Explain. 

(d) Find the convolution y^[n\ = x[n/ 2] *;r[n/2], assuming step interpolation. Is y^[n] related to 
y[n\? Should it be? Explain. 

(e) Find the convolution y 4 [n\ = a;[n/2] -kx[n/ 2], assuming linear interpolation. Is j/ 4 [n] related to 
y[n\7 Should it be? Explain. 


3.57 (Linear Interpolation) Consider a system that performs linear interpolation by a factor of N. One 
way to construct such a system, as shown, is to perform up-sampling by N (zero interpolation between 
signal samples) and pass the up-sampled signal through a filter with impulse response h [n\ whose 
output y[n] is the linearly interpolated signal. 


up-sample (zero interpolate) by N 


filter 


y[r~ 


(a) What should h[n] be for linear interpolation by a factor of N7 

(b) Let x[n] = 4tri(0.25n). Find y\[n] = x[n/ 2] by linear interpolation. 

(c) Find the system output y[n] for N = 2. Does y[n] equal y\[n}7 


3.58 (Causality) Argue that the impulse response h[n] of a causal system must be zero for n < 0. Based 
on this result, if the input to a causal system starts at n = no, when does the response start? 

3.59 (Stability) Investigate the causality and stability of the following systems. 

(a) h[n] = (2 ) n u[n — 1] (b) y[n] = 2 x[n + 1] + 3 x[n\ — x[n — 1] 

(c) h[n\ = (— 0.5)"w[n] (d) h[n\ = {3,2,1,1,2} 

(e) h[n} = (0.5)“"u[—n] (f) h[n] = (0.5)l n l 

[Hints and Suggestions: Only one of these is unstable. For part (e), note that summing |/i[n]| is 

equivalent to summing its folded version.] 

3.60 (Numerical Convolution) The convolution y(t) of two analog signals x{t) and h(t) may be approx¬ 
imated by sampling each signal at intervals t s to obtain the signals x[n] and h[n], and folding and 
shifting the samples of one function past the other in steps of t s (to line up the samples). At each 
instant kt s , the convolution equals the sum of the product samples multiplied by t s . This is equivalent 
to using the rectangular rule to approximate the area. If x[n\ and h[n] are convolved using the sum- 
by-column method, the columns make up the product, and their sum multiplied by t s approximates 
y(t) at t = kt s . 

(a) Let x(t) = rect(t/2) and h(t) = rect(t/2). Find y(t) = x(t) *h{t) and compute y(t) at intervals 
of t s = 0.5 s. 
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(b) Sample x(t) and h(t) at intervals of t s = 0.5 s to obtain x[n] and h[n]. Compute y[n] = x[n\*h[n] 
and the convolution estimate yn(nt s ) = t s y[n]. Do the values of yFi(nt s ) match the exact result 
y(t) at t = nt s ? If not, what are the likely sources of error? 

(c) Argue that the trapezoidal rule for approximating the convolution is equivalent to subtracting 
half the sum of the two end samples of each column from the discrete convolution result and 
then multiplying by t s . Use this rule to obtain the convolution estimate grants). Do the values 
of yrints) match the exact result y(t) at t = nt a ? If not, what are the likely sources of error? 

(d) Obtain estimates based on the rectangular rule and trapezoidal rule for the convolution y(t) of 
x(t) = 2tri(f) and h(t) = rect(f/2) by sampling the signals at intervals of t s = 0.5 s. Which rule 
would you expect to yield a better approximation, and why? 


3.61 (Convolution) Let x[n\ = rect(n/2) and h[n} = rect(n/4). 

(a) Find f[n] = x[n] *x[n] and g[n\ = h[n\ * h[n\. 

(b) Express these results as f[n] = A tri(n/M) and g[n ] = B tri(n/K) by selecting appropriate values 
for the constants A, M, B and K. 

(c) Generalize the above results to show that rect(n/2?V) * rect(n/27V) = (2TV + l)tri( 2j ^ t +1 ). 

3.62 (Impulse Response of Difference Algorithms) Two systems to compute the forward difference 
and backward difference are described by 

Forward difference: yi?[n] = x[n + 1] — x[n] Backward difference: 2 /s[?r] = x[n] — x[n — 1] 

(a) What is the impulse response of each system? 

(b) Which of these systems is stable? Which of these systems is causal? 

(c) Find the impulse response of their parallel connection. Is the parallel system stable? Is it causal? 

(d) What is the impulse response of their cascade? Is the cascaded system stable? Is it causal? 


3.63 (System Response) Find the response of the following filters to the unit step x[n ] = u[n\, and to 
the alternating unit step x[n ] = (—l)"u[n], using convolution concepts. 

(a) h[n] = <5[n] — (5[n — 1] (differencing operation) 

If 

(b) h[n] = {0.5, 0.5} (2-point average) 

N-l 

(c) h[n] = jj ^2 S[n — k], N = 3 (moving average) 

k =o 

N-l 

(d) h[n] = 

N(N+1) E (N — k)S[n — k], N = 3 (weighted moving average) 
k—0 

(e) y[n] + ^A)/[n — 1] = N = 3 (exponential average) 


Jf 

3.64 (Convolution and Interpolation) Consider the following system with x[n] = {0, 3, 9,12,15,18}. 

x[n] —> zero interpolate by N —> filter —> y[n\ 


(a) Find the response y[n] if N = 2 and the filter impulse response is h[n\ = {l, 1}. Show that, 
except for end effects, the output describes a step interpolation between the samples of x[n}. 

Jf 

(b) Find the response y[n] if N = 3 and the filter impulse response is h[n] = {l, 1, 1}. Does the 
output describe a step interpolation between the samples of x[n\? 
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(c) Pick N and h[n] if the system is to perform step interpolation by 4. 


3.65 (Convolution and Interpolation) Consider the following system with x[n] = {0, 3, 9,12,15,18}. 

filter —> y[n\ 


x\n\ 


zero interpolate by N 


(a) Find the response y[n] if TV = 2 and the filter impulse response is h.[n] = tri(n/2). Show that, 
except for end effects, the output describes a linear interpolation between the samples of x[n}. 

(b) Find the response y[n\ if N = 3 and the filter impulse response is h[n] = tri(n/3). Does the 
output describe a linear interpolation between the samples of x[n \? 

(c) Pick N and h[n] if the system is to perform linear interpolation by 4. 


3.66 (Interconnected Systems) Consider two systems described by 

hi[n] = <5[n] + a5[n — 1] / 12 M = (0.5)"u[n] 

Find the response to the input x[n\ = (0.5)"zt[ n ] if 

(a) The two systems are connected in parallel with a = 0.5. 

(b) The two systems are connected in parallel with a = —0.5. 

(c) The two systems are connected in cascade with a = 0.5. 

(d) The two systems are connected in cascade with a = —0.5. 

3.67 (Systems in Cascade and Parallel) Consider the realization of Figure P3.67. 



(a) Find its impulse response if a ^ (3. Is the overall system FIR or HR? 

(b) Find its impulse response if a = (3. Is the overall system FIR or HR? 

(c) Find its impulse response if a = (3 = 1. What does the overall system represent? 


3.68 (Cascading) The impulse response of two cascaded systems equals the convolution of their impulse 
responses. Does the step response sc[n ] of two cascaded systems equal si[n] *S2[?r], the convolution of 
their step responses? If not, how is sc[n} related to Si[n] and S2[n]? 


3.69 (Cascading) System 1 is a squaring circuit, and system 2 is an exponential averager described by 
h[n] = (0.5)"u[n]. Find the output of each cascaded combination. Will their output be identical? 
Should it be? Explain. 


(a) 2(0.5) n u[?r] —> system 1 


system 2 


y M 


(b) 2(0.5) n u[n] —> system 2 


system 1 


y[n] 
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3.70 (Cascading) System 1 is an HR filter with the difference equation y[n\ = 0.5 y[n — 1] + a :[n\, and 
system 2 is a filter with impulse response h[n] = <5[n] — S[n — 1]. Find the output of each cascaded 
combination. Will their output be identical? Should it be? Explain. 

(a) 2(0.5) n u[n] —* system 1 —> system 2 —> y[n] 

(b) 2(0.5)"u[n] —> system 2 —> system 1 —> y[n ] 

3.71 (Cascading) System 1 is an HR filter with the difference equation y[n\ = 0.5 y[n — 1] + x[n\, and 
system 2 is a filter with impulse response h[n] = <5[?r] — (0.5)"it[n]. 

(a) Find the impulse response hp[n\ of their parallel connection. 

(b) Find the impulse response /i 12 [n] of the cascade of system 1 and system 2. 

(c) Find the impulse response h 2 i[n\ of the cascade of system 2 and system 1. 

(d) Are /t-| 2 [n] and /i 2 i[n] identical? Should they be? Explain. 

(e) Find the impulse response hj[n] of a system whose parallel connection with h\ 2 [n\ yields hp[n\. 

3.72 (Cascading) System 1 is a lowpass filter described by y[n ] = 0.5y[?r — 1] + a;[n], and system 2 is 
described by h[n] = 5[n] — 0.5(5[n — 1]. 

(a) What is the output of the cascaded system to the input x[n] = 2(0.5)”u[n]? 

(b) What is the output of the cascaded system to the input x[n] = <5[n]? 

(c) How are the two systems related? 

3.73 (Convolution in Practice) Often, the convolution of a long sequence x[n] and a short sequence h[n] 
is performed by breaking the long signal into shorter pieces, finding the convolution of each short piece 
with h[n], and “gluing” the results together. Let x[n] = {1, 1, 2, 3, 5, 4, 3, 1} and h[n\ = {4, 3, 2, 1}. 

(a) Split x[n] into two equal sequences x\ [n\ = {1, 1, 2, 3} and ^[n] = {5, 4, 3, 1}. 

(b) Find the convolution yi[n] = h[n] *aq[n]. 

(c) Find the convolution 2 / 2 M = h[n\ *X 2 [n]. 

(d) Find the convolution y[n] = h[n ] -kx[n]. 

(e) How can you find y[n] from y±[n\ and 

[Hints and Suggestions: For part (e), use superposition and add the shifted version of [n] to y-\ [n] 
to get y[n]. This forms the basis for the overlap-add method of convolution.] 

3.74 (Periodic Convolution) Find the regular convolution y[n] = x[n) * h[n] of one period of each pair 
of periodic signals. Then, use wraparound to compute the periodic convolution y p [n\ = x[n\®h[n]. In 
each case, specify the minimum number of padding zeros we must use if we wish to find the regular 
convolution from the periodic convolution of the zero-padded signals. 

(a) x[n ] = (1, 2, 0, 1} h[n] = {2, 2, 3, 0} 

(b) x[n] = {0, 2, 4, 6} h[n] = {6, 4, 2, 0} 

(c) x[n\ = {-3, -2, -1, 0, 1} h[n] = { 4 , 3, 2, 0, 0} 

(d) x[n] = {3, 2, 1, 1 , 2} h[n] = {4, 2, 3, 2, 0} 

[Hints and Suggestions: First assign the marker for the regular convolution. After wraparound, 
this also corresponds to the marker for the periodic convolution.] 
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3.75 (Periodic Convolution) Find the periodic convolution y p [n] 
using the circulant matrix for x [n]. 


(a) x[n] = ( 1 , 2 , 0,1} 

(b) x[n] = (0,2,4,6} 


h[n\ = {2,2,3,0} 
%] = {6,4,2,0} 


x[n}®h[n] for each pair of signals 


3.76 (Periodic Convolution) Consider a system whose impulse response is h[n ] = (0.5)”u[n]. Show that 

(0.5)™ 

one period of its periodic extension with period N is given by ft, pe [?r] = -- N , 0 < n < N — 1. 

1 (0.5) 

Use this result to find the response of this system to the following periodic inputs. 


JJ. 

(a) x[n ] = cos(n7r) (b) x[n] = {l, 1, 0, 0}, with N = 4 

(c) x[n] = cos(0.5n7r) (d) x[n ] = (0.5)™, 0 < n < 3, with N = 4 


[Hints and Suggestions: In each case, compute N samples of h pe [n\ and then get the periodic 
convolution. For example, the period of x[n\ in part (a) is N = 2.] 


3.77 (Correlation) For each pair of signals, compute the autocorrelation r xx [n], the autocorrelation rhh[n ], 
the cross-correlation r x h[n\, and the cross-correlation r^ x [n]. For each result, indicate the location of 
the origin n = 0 by a marker. 


(a) x[n] = {1,2,0,1} 

(b) x[n] = {0,2,4,6} 

(c) x[n] = {-3,-2,-1,2} 

(d) x[n] = { 3, 2,1,1,2} 


h[n\ = {2, 2, 3} 
h[n\ = {6,4,2} 
h[n\ = {4, 3, 2} 
%] = {4,2,3,2} 


[Hints and Suggestions: Use convolution to get the correlation results. For example, r x h[n] = 
x[n\ * h[—n\ and the marker for the result is based on x\n\ and h[—n] (the sequences convolved).] 


3.78 (Correlation) Let x[n\ = rect[(n — 4)/2] and h[n\ = rect[n/4]. 

(a) Find the autocorrelation r xx [n]. 

(b) Find the autocorrelation [n]. 

(c) Find the cross-correlation r x h[n\. 

(d) Find the cross-correlation r> ix [n]. 

(e) How are the results of parts (c) and (d) related? 


3.79 (Correlation) Find the correlation r x j t [n] of the following signals. 


(a) x[n} = a n u[n] 

h[n] 

= a™u[?r] 

(b) x[n ] = na n u[n] 

h[n] 

= a n u[n] 

(c) x[n} = rect(n/2A r ) 

h[n] 

= rect(n/21V) 


[Hints and Suggestions: In parts (a) and (b), each correlation will cover two ranges. For n > 0, the 
signals overlap over n < k < oo and for n < 0, the overlap is for 0 < k < oo. For part (c), x[n ] and 
h[n] are identical and even symmetric and their correlation equals their convolution.] 

3.80 (Periodic Correlation) For each pair of periodic signals described for one period, compute the 
periodic autocorrelations r pxx [n\ and r p hh[n \, and the periodic cross-correlations r px h[n] and r p h x [n\. 
For each result, indicate the location of the origin n = 0 by a marker. 
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(a) x[n] = {1,2,0,1} 

(b) x[n\ = {0,2,4,6} 

(c) x[n] = {-3,-2,-1,2} 

(d) x[n] = { 3,2,1,1,2} 


h[n] = {2,2,3,0} 
h[n] = {6,4,2,0} 
h[n\ = {0,4,3,2} 
%] = {4,2, 3,2,0} 


[Hints and Suggestions: First get the regular correlation (by regular convolution) and then use 
wraparound. For example, r x h[n ] = x[n] * h[—n] and the marker for the result is based on x[n\ and 
h[—n\ (the sequences convolved). Then, use wraparound to get r px h[n] (the marker may get wrapped 
around in some cases).] 


3.81 (Mean and Variance from Autocorrelation) The mean value m x of a random signal x[n] (with 
nonzero mean value) may be computed from its autocorrelation function r xx [n ] as m^, = lim r xx [n\. 

|n|—>oo 

The variance of x[n] is then given by a x = r xx ( 0) — m x . Find the mean, variance, and average power 
of a random signal whose autocorrelation function is r xx [n] = 10 


/1+2n 2 \ 
\2 + 5n 2 J' 


COMPUTATION AND DESIGN 


3.82 (Numerical Integration Algorithms) Numerical integration algorithms approximate the area y[n] 
from y[n — 1] or y[n — 2] (one or more time steps away). Consider the following integration algorithms. 

(a) y[n] = y[n — 1] + t s x[n] (rectangular rule) 

(b) y[n] = y[n — 1] + ^(x[n\ + x[n — 1]) (trapezoidal rule) 

(c) y[n] = y[n — 1] + |j(5o;[n] + 8 x[n — 1] — x[n — 2]) (Adams-Moulton rule) 

(d) y[n] = y[n — 2] + y {x[n\ + Ax[n — 1] + x[n — 2]) (Simpson’s rule) 

(e) y[n] = y[n — 3] + ^(a;[?r] + 3 x[n — 1] + 3a :[n — 2] + x[n — 3]) (Simpson’s three-eighths rule) 

Use each of the rules to approximate the area of x(t) = sinc(t), 0 < t < 3, with t s = 0.1s and t s = 0.3 s, 
and compare with the expected result of 0.53309323761827. How does the choice of the time step t s 
affect the results? Which algorithm yields the most accurate results? 

3.83 (System Response) Use the Matlab routine filter to obtain and plot the response of the filter 
described by y[n\ = 0.25(a;[n] + x[n — 1] + a:[n — 2] + a:[n — 3]) to the following inputs and comment on 
your results. 

(a) x[n\ = 1, 0 < n < 60 

(b) x[n] = O.ln, 0 < n < 60 

(c) x[n\ = sin(0.1?X7r), 0 < n < 60 

(d) a in] = O.ln + sin(0.5n7r), 0 < n < 60 

OO 

(e) x[n] = ^ 5[n — 5k\, 0 < n < 60 

k ——oo 

OO 

(f) x[n\ = 5[n — 4 At] , 0 < n < 60 
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3.84 (System Response) Use the Matlab routine filter to obtain and plot the response of the filter 
described by y[n] — y[n — 4] = 0.25 (x[n\ + x[n — 1] + x[n — 2] + x[n — 3]) to the following inputs and 
comment on your results. 

(a) x[n] = 1, 0 < n < 60 

(b) x[n] = 0.1 n, 0 < n < 60 

(c) x[n] = sin(0.1?X7r), 0 < n < 60 

(d) x[n] = O.ln + sin(0.5n7r), 0 < n < 60 

OO 

(e) x[n] = Y^ 6[n — 5k], 0 < n < 60 

k —— oo 

OO 

(f) x[n] = Y 5[n — 4 At] , 0 < n < 60 

k —— oo 

3.85 (System Response) Use Matlab to obtain and plot the response of the following systems over the 
range 0 < n < 199. 

(a) y[n] = a;[?r/3], x[n] = (0.9)”w[n] (assume zero interpolation) 

(b) y[n] = cos(0.2n7r)x[?i], x[n] = cos(0.04n7r) (modulation) 

(c) y[n] = [1 + cos(0.2n7r)]a;[n], x[n] = cos(0.04?r7r) (modulation) 

3.86 (System Response) Use Matlab to obtain and plot the response of the following filters, using direct 
commands (where possible) and also using the routine filter, and compare your results. Assume that 
the input is given by x[n] = 0.1?r + sin(0.1n7r), 0 < n < 60. Comment on your results. 

JV-l 

(a) y[n] = ^ x[n — k], N = 4 (moving average) 

k =o 

N—l 

(b) y[n] 

~ N(N+1) E (N — k)x[n — k\, N = 4 (weighted moving average) 
k=0 

(c) y[n] — ay[n — 1] = (1 — a)a;[n], N = 4, a = (exponential average) 

3.87 (System Response) Use Matlab to obtain and plot the response of the following filters, using 
direct commands and using the routine filter, and compare your results. Use an input that consists 
of the sum of the signal x[n] = O.ln + sin(0.1?r7r), 0 < n < 60 and uniformly distributed random noise 
with a mean of 0. Comment on your results. 

N—l 

(a) y[n] = ^ Y] x[n — k], N = 4 (moving average) 

k =o 

N—l 

(b) y[n] 

~ N(N+1) E (N — k)x[n — k], N = 4 (weighted moving average) 
k=0 

(c) y[n] — ay[n — 1] = (1 — a)a;[n], N = 4, a = (exponential averaging) 

3.88 (System Response) Use the Matlab routine f ilter to obtain and plot the response of the following 
FIR filters. Assume that x[n) = sin(n7r/8), 0 < n < 60. Comment on your results. From the results, 
can you describe the the function of these filters? 

(a) y[n\ = x[n\ — x[n — 1] (first difference) 

(b) y[n] = x[n ] — 2 x[n — 1] + x[n — 2] (second difference) 
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(c) y[n] = g(a;[n] + x[n — 1] + x[n — 2]) (moving average) 

(d) y[n] = 0.5cc[n] + x[n — 1] + 0.5a :[n — 2] (weighted average) 

3.89 (System Response in Symbolic Form) Determine the response y[n\ of the following filters and 
plot over 0 < n < 30. 

(a) The step response of y[n] — 0.5 y[n — 1] = x\n ] 

(b) The impulse response of y[n\ — 0.5y[n — 1] = x[n] 

(c) The zero-state response of y[n] — 0.5 y[n — 1] = (0.5)"it[ n ] 

(d) The complete response of y[n] — 0.5 y[n — 1] = (0.5)"u[n], a/[—1] = —4 

(e) The complete response of y[n] + y[n — 1] + 0.5 y[n — 2] = (0.5)"w[n], y{— 1] = —4, y{— 2] = 3 

3.90 (Inverse Systems and Echo Cancellation) A signal x(t) is passed through the echo-generating 
system y(t) = x(t) + 0.9x(f — r) + 0.8x(t — 2r), with r = 93.75 ms. The resulting echo signal y(t) is 
sampled at S = 8192 Hz to obtain the sampled signal y[n}. 

(a) The difference equation of a digital filter that generates the output y[n\ from x[n\ may be written 
as y[n] = x[n] + 0.9a;[n — N] + 0.8x[n — 2 N], What is the value of the index N ? 

(b) What is the difference equation of an echo-canceling filter (inverse filter) that could be used to 
recover the input signal x[n]? 

(c) The echo signal is supplied on the author’s website as echosig.mat. Load this signal into Matlab 
( using the command load echosig). Listen to this signal using the Matlab command sound. 
Can you hear the echoes? Can you make out what is being said? 

(d) Filter the echo signal using your inverse filter and listen to the filtered signal. Have you removed 
the echoes? Can you make out what is being said? Do you agree with what is being said? 

3.91 (Nonrecursive Forms of HR Filters) An FIR filter may always be exactly represented in recursive 
form, but we can only approximately represent an HR filter by an FIR filter by truncating its impulse 
response to N terms. The larger the truncation index N, the better is the approximation. Consider 
the HR filter described by y[n] — 0.8 y[n — 1] = x[n}. Find its impulse response h[n] and truncate it to 
20 terms to obtain Iia [n], the impulse response of the approximate FIR equivalent. Would you expect 
the greatest mismatch in the response of the two filters to identical inputs to occur for lower or higher 
values of n? 

(a) Use the Matlab routine filter to find and compare the step response of each filter up to n = 15. 
Are there any differences? Should there be? Repeat by extending the response to n = 30. Are 
there any differences? For how many terms does the response of the two systems stay identical, 
and why? 

(b) Use the Matlab routine filter to find and compare the response to x[n] = 1, 0 < n < 10 for 
each filter up to n = 15. Are there any differences? Should there be? Repeat by extending the 
response to n = 30. Are there any differences? For how many terms does the response of the 
two systems stay identical, and why? 

3.92 (Convolution of Symmetric Sequences) The convolution of sequences that are symmetric about 
their midpoint is also endowed with symmetry (about its midpoint). Use the Matlab command 
conv to find the convolution of the following sequences and establish the type of symmetry (about the 
midpoint) in the convolution. 


( a ) 

x[n ] 

= sin(0.2n7r), 

-10 < n < 10 

h[n] 

= sin(0.2n7r), 

-10 < n < 10 

(b) 

x[n ] 

= sin(0.2n7r), 

-10 < n < 10 

h[n] 

= cos(0.2n7r), 

-10 < n < 10 

( c ) 

x[n ] 

= cos(0.2?r7r), 

-10 < n < 10 

h[n) 

= cos(0.2n7r), 

-10 < n < 10 

(d) 

x[n ] 

= sinc(0.2?i), 

-10 < n < 10 

h[n] 

= sinc(0.2n), 

-10 < n < 10 
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3.93 (Extracting Periodic Signals Buried in Noise) Extraction of periodic signals buried in noise 
requires autocorrelation (to identify the period) and cross-correlation (to recover the signal itself). 

(a) Generate the signal x[n] = sin(0.1ri7r), 0 < n < 499. Add some uniform random noise (with a 
noise amplitude of 2 and a mean of 0) to obtain the noisy signal s[n]. Plot each signal. Can you 
identify any periodicity from the plot of x [«] ? If so, what is the period N1 Can you identify any 
periodicity from the plot of s[n]? 

(b) Obtain the periodic autocorrelation r px [n ] of x[n ] and plot. Can you identify any periodicity 

from the plot of r pa; [n]? If so, what is the period N? Is it the same as the period of x[n}7 

(c) Use the value of N found above (or identify N from x[n\ if not) to generate the 500-sample 

impulse train i[n] = — kN], 0 < n < 499. Find the periodic cross-correlation y[n] of 

s [n] and i[n\. Choose a normalizing factor that makes the peak value of y[n\ unity. How is the 
normalizing factor related to the signal length and the period N? 

(d) Plot y[n\ and x[n\ on the same plot. Is y[n\ a close match to x[n]l Explain how you might 

improve the results. 
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z-TRANSFORM ANALYSIS 


4.0 Scope and Objectives 

This chapter deals with the z-transform as a method of system analysis in a transformed domain. Even 
though its genesis was outlined in the previous chapter, we develop the z-transform as an independent 
transformation method in order to keep the discussion self-contained. We concentrate on the operational 
properties of the z-transform and its applications in systems analysis. Connections with other transform 
methods and system analysis methods are explored in later chapters. 


4.1 The Two-Sided ^-Transform 

The two-sided z-transform X(z) of a discrete signal x[n] is defined as 

OO 

*(*)= E x[k]z k (two-sided z-transform) 

k =—oo 

The relation between x[n\ and X(z) is denoted symbolically by 


x[n] 4= zt |=» X{z) 


(4.1) 


(4.2) 


Here, x[n\ and X(z) form a transform pair, and the double arrow implies a one-to-one correspondence 
between the two. 


4.1.1 What the z -Transform Reveals 

The complex quantity z generalizes the concept of digital frequency F or fi to the complex domain and is 
usually described in polar form as 

(4.3) 


z = \r\e j2 * F = \r\e> n 


Values of the complex quantity z may be displayed graphically in the z-plane in terms of its real and 
imaginary parts or in terms of its magnitude and angle. 

The defining relation for the z-transform is a power series (Laurent series) in z. The term for each index 
k is the product of the sample value x[k\ and z~ k . 

4 

For the sequence x[n ] = {—7, 3, 1, 4, —8, 5}, for example, the z-transform may be written as 

X{z) = -7 z 2 + 3Z 1 + z° + 4z _1 - 8z" 2 + 5z -3 
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Comparing x[n] and X(z), we observe that the quantity 2 _1 plays the role of a unit delay operator. The 
sample location n = 2 in x[n], for example, corresponds to the term with z~ 2 in X(z). In concept, then, it 
is not hard to go back and forth between a sequence and its 2 -transform if all we are given is a finite number 
of samples. 


The Two-Sided 2 - Transform of Fii 

REVIEW PANEL 4.1 

nite Sequences Is a Powi 

er Series in 2 

1 1 


DRILL PROBLEM 4.1 


(a) Let x[n] = {2, 1, 0, 4}. Find its 2 -transform X(z). 

4 

(b) Let x\n\ = {2, —3, 1, 0, 4}. Find its 2 -transform X(z). 

(c) Let X(z) = 3 2 2 + 2 — 32 _1 + 52 -2 . Find a:[n]. 

Answers: (a) 2 + 2 _1 + 42 -3 (b) 2z 2 — 3z + 1 + 4z~ 2 (c) {3, 1, 0, —3, 5} 


Since the defining relation for X ( 2 ) describes a power series, it may not converge for all 2 . The values of 
2 for which it does converge define the region of convergence (ROC) for X(z). Two completely different 
sequences may produce the same two-sided 2 -transform X(z), but with different regions of convergence. It is 
important that we specify the ROC associated with each A ( 2 ), especially when dealing with the two-sided 
2 -transform. 

4.1.2 Some z-Transform Pairs Using the Defining Relation 

Table 17.1 lists the ^transforms of some useful signals. We provide some examples using the defining relation 
to find 2 -transforms. For finite-length sequences, the 2 -transform may be written as a polynomial in 2 . For 
sequences with a large number of terms, the polynomial form can get to be unwieldy unless we can find 
closed-form solutions. 


EXAMPLE 4.1 (The 2 - Transform from the Defining Relation) 

(a) Let x[n] = S [n]. Its 2 -transform is X(z) = 1. The ROC is the entire 2 -plane. 


4 

(b) Let x[n] = 2 S[n + 1] + 8]v\ — 5 S[n — 1] + 4 5[n — 2]. This describes the sequence x[n] = {2,1, —5,4}. Its 
2 -transform is evaluated as X(z) = 2z + 1 — 52 _1 + 42 -2 . No simplifications are possible. The ROC is 
the entire 2 -plane, except 2 = 0 and 2 = 00 (or0< \z\ < 00 ). 


(c) Let x[n] = u[n ] — u[n — IV]. This represents a sequence of N samples, and its 2 -transform may be 
written as 

X ( 2 ) = 1 + 2 " 1 + 2 " 2 + • • • + 2 “ (JV - 1) 

Its ROC is | 2 1 >0 (the entire 2 -plane except 2 = 0). A closed-form result for X(z) may be found using 
the defining relation as follows: 


JV-l 


X(Z) = £ 2- fc 
fc =0 


1 -z~ N 

1 — 2 —1 


2^1 
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Table 4.1 A Short Table of z -Transform Pairs 


Entry 

Signal 

^-Transform 

ROC 


Finite Sequences 


1 

%] 

1 

all 2 

2 

u[n\ — u[n — A] 

1 -z~ N 

1-z- 1 

0 


Causal Signals 


3 

u[n\ 

z 

z- 1 

1*1 

> 1 

4 

a n u[n ] 

z 

z — a 

1*1 

> M 

5 

(-a)"«[?i] 

z 

z + a 

1*1 

> M 

6 

nu[n\ 

z 

(*-1) 2 

1*1 

> l 

7 

na n u[n] 

za 

(z — a) 2 

1*1 

> M 

8 

cos(nO)u[?r] 

z 2 — z cos 0 
z 2 — 2 z cos 0 + 1 

1*1 

> l 

9 

sin(?rO)w[n] 

z sin 0 

z 2 — 2 z cos 0 + 1 

1*1 

> l 

10 

a n cos(nO)ii[«] 

z 2 — az cos 0 
z 2 — 2 az cos 0 + a 2 

1*1 

> M 

11 

a n sin(?rO)w[n] 

az sin 0 

z 2 — 2 az cos 0 + a 2 

1*1 

> M 


Anti-Causal Signals 


12 

1 

s 

1 

3 

1 

i—‘ 

z 

z- 1 

1*1 

< 1 

13 

—nu[—n — 1 ] 

z 

(*-1) 2 

1*1 

< 1 

14 

— a n u[—n — 1 ] 

z 

z — a 

1*1 

< M 

15 

—na n u[—n — 1 ] 

za 

(.z — a) 2 

1*1 

< M 
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(d) Let x[n ] = u[n\. We evaluate its 2 -transform using the defining relation as follows: 


OO OO 1 

X{z) = i-=T = ^T> R0C: \*\ > 1 

' 1 — z 1 z — 1 

k=0 k=0 


Its ROC is \z\ > 1 and is based on the fact that the geometric series ^r fc converges only if |r| < 1. 


k =o 


(e) Let x[n] = a n u[n]. Using the defining relation, its 2 -transform and ROC are 

1 2 




k =0 


k =0 


2 7 1 — {a/z) z — a 


ROC: \z\ > led 


Its ROC (| 2 | > a) is also based on the fact that the geometric series ^ r k converges only if |r| < 1. 


k =o 


DRILL PROBLEM 4.2 | 

(a) Let x[n] = (0.5) n u[n]. Find its 2 -transform X(z) and ROC. 

(b) Let y[n] = (—0.5)"u[n]. Find its 2 -transform Y(z) and ROC. 

(c) Let g[n\ = — (0.5)"u[— n — 1]. Find its 2 -transform G(z) and ROC. 

Answers: (a) X(z) = _ _* Q ^ , \z\ > 0.5 (b) Y(z) = ^ + " Q \z\ > 0.5 (c) G(z) = ^ 5 , \z\ C 0- 5 


4.1.3 More on the ROC 

For a finite sequence ®[n], the 2 -transform X(z) is a polynomial in 2 or z^ 1 and converges (is finite) for all 
2 , except 2 = 0, if X(z) contains terms of the form z~ k (or x[n] is nonzero for n > 0), and/or 2 = 00 if X(z) 
contains terms of the form z k (or x[n] is nonzero for n < 0). Thus, the ROC for finite sequences is the entire 
2 -plane, except perhaps for 2 = 0 and/or 2 = 00 , as applicable. 

In general, if X(z) is a rational function in z, as is often the case, its ROC actually depends on the one- 
or two-sidedness of x[n], as illustrated in Figure 4.1. 

The ROC excludes all pole locations (denominator roots) where X(z) becomes infinite. As a result, 
the ROC of right-sided signals is \z\ > |p| m ax and lies exterior to a circle of radius |p| m ax, the magnitude 
of the largest pole. The ROC of causal signals, with x[n] = 0, n < 0, excludes the origin and is given 
by 0 > \z\ > p|max• Similarly, the ROC of a left-sided signal x[n] is \z\ < |p| m in and lies interior to a 
circle of radius |p| m in, the smallest pole magnitude of X(z). Finally, the ROC of a two-sided signal x [n] is 
blmin < \z\ < blmax, an annulus whose radii correspond to the smallest and largest pole locations in X(z). 
We use inequalities of the form \z\ < |a| (and not \z\ < |a|), for example, because X(z) may not converge 
at the boundary \z\ = |a|. 
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ROC (shaded) of right-sided signals ROC (shaded) of left-sided signals ROC (shaded) of two-sided signals 


Figure 4.1 The ROC (shown shaded) of the ^-transform for various sequences 


REVIEW PANEL 4.2 


The ROC of the z- Transform X(z) Determines the Nature of the Signal x[n} 
Finite-length x[n ]: ROC of X(z) is all the z-plane, except perhaps for z = 0 and/or z = oo. 

Right-sided x[n]: ROC of X(z) is outside a circle whose radius is the largest pole magnitude. 

Left-sided x[n ]: ROC of X(z) is inside a circle whose radius is the smallest pole magnitude. 

Two-sided x[n]: ROC of X(z) is an annulus bounded by the largest and smallest pole radius. 


Why We Must Specify the ROC 


Consider the signal y[n\ = —a n u[—n — 1] = —1, n = —1, —2,.... The two-sided 2 -transform of y[n], using a 
change of variables, can be written as 


Y{z)= E -u k z~ k 

k =—oo 


E °° / z\ m z/a. z 

Va/ 1 — (z/a) z — a' 

m—1 v ' ' 


ROC: \z\ < |a| 


Z 

The ROC of Y{z) is \z\ < |a|. Recall that the 2 -transform of x[n\ = a n u[n] is X(z) = -. This is 

z — a 

identical to Y(z) but the ROC of X(z) is \z\ > |a|. So, we have a situation where two entirely different 
signals may possess an identical 2 -transform and the only way to distinguish between the them is by their 
ROC. In other words, we cannot uniquely identify a signal from its transform alone. We must also specify 
the ROC. In this book, we shall assume a right-sided signal if no ROC is specified. 


EXAMPLE 4.2 (Identifying the ROC) 

(a) Let x[n] = {4, —3, 2, 6}. The ROC of X(z) is 0 < \z\ < oo and excludes z = 0 and z = oo because 
x[n\ is nonzero for n < 0 and n > 0. 


(b) Let X{z) = 

Its ROC depends on the nature of x[n}. 

If x[n] is assumed right-sided, the ROC is \z\ > 3 (because |p| ma x = 3). 

If x[n] is assumed left-sided, the ROC is \z\ < 2 (because |p| m i n = 2). 

If x[n] is assumed two-sided, the ROC is 2 < \z\ < 3. 

The region \z\ < 2 and \z\ > 3 does not correspond to a valid region of convergence because we must 
find a region that is common to both terms. 
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DRILL PROBLEM 4.3 


(a) Let X(z) = Z + What is its ROC? 


(b) Let Y(z) = 

(c) Let G(z) = 


2+1 


(z — 0.1)(2 + 0.5) 


. What is its ROC if x[n\ is right-sided? 


2 + 2 z — 1 


. What is its ROC if g[n\ is two-sided? 


(d) Let H{z) = j — ^2)^( ^+ 1) ’ ^ M n ] left-sided? 

Answers: (a) \z\ ^ 0 (b) \z\ > 0.5 (c) 1 < \z\ < 2 (d) \z\ < 1 


4.2 Properties of the Two-Sided z-Transform 

The 2 -transform is a linear operation and obeys superposition. The properties of the 2 -transform, listed in 
Table 4.2, are based on the linear nature of the 2 -transform operation. 


Table 4.2 Properties of the Two-Sided 2 -Transform 


Entry 

Property 

Signal 

2 -Transform 

1 

Shifting 

x[n — A] 

z~ N X(z) 

2 

Reflection 

x[—n\ 

T— 1 | 

* 

3 

Anti-causal 

x[—n]u[—n — 1] 

A^-^ — x[0] (for causal x[n\) 

4 

Scaling 

a n x[n\ 

X® 

5 

Times-n 

nx[n] 

dX(z) 

~ dz 

6 

Times-cos 

cos(nfl)a:[?7] 

0.5 [X(ze jn ) + A (ze-^)] 

7 

Times-sin 

sin(?rfl)a;[n] 

j0.5 [A( 2 e? n ) - A( 2 e“? n )] 

8 

Convolution 

x[n] * h[n\ 

X(z)H(z) 


Time Shift: To prove the time-shift property of the two-sided 2 -transform, we use a change of variables. 
We start with the pair x[n\ 


ZT 


X(z). If y[n] = x[n — A], its 2 -transform is 


OO 

Y{z) = J2 x \ k - N]z~ k 

k =—oo 


(4.4) 


With the change of variable m = k — N, the new summation index m still ranges from —oo to oo (since N 
is finite), and we obtain 


OO OO 

Y(z) = x[m]z- {m+N) = z~ N Yj x [ m \ z ~ m = z~ N X(z) 

m =—oo 


(4.5) 
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The factor z N with X(z) induces a right shift of N in x\n\. 



REVIEW PANEL 4.3 


Time-Shift Property for the Two-Sided 2 -Transform: x[n 

. — IV] 4= ZT => 2 N X(z) 


DRILL PROBLEM 4.4 | 

(a) Let X(z) = 2 + 5 z~ 1 . Find the 2 -transform of y[n\ = x[n — 3]. 

(b) Use the result (0.5) n u[n] <= | ZT | => -— to find g[n] if G(z) -— 

Z U.D Z U.O 

Answers: (a) Y(z) = 2 z~ 3 + 5 z~ 4 (b) g [n] = (0.5)" _1 u[n — 1] 


(4.6) 


(4.7) 


The Times-?! Property: nx[n\ <+[ 

REVIEW PANEL 4.4 

- dX(z) 

ZT => -2 - 

- dz 

1 [ 


DRILL PROBLEM 4.5 


(a) Let X(z) = 2 + 52 1 — 4 z 2 . Find the 2 -transform of y[n] = nx[v\. 

(b) Let G(z) = —A—, ROC : \z\ > 0.5. Find the 2 -transform of h[n] = ng[n] and its ROC. 

Z U.O 

0 5 z 

Answers: (a) Y(z) = 5 2 _1 — 82 -2 (b) H(z) = - - ' , \z\ > 0.5 

( Z U.O ) 


Times-n: The times-n property is established by taking derivatives, to yield 


x ( z ) = Y2 x ^ z 


-k 


k——oo 

Multiplying both sides by — 2 , we obtain 


dX(z) 

dz 


= J2 Jz ^ = £ -kx[k]:. 


-(fc+i) 


k=—oo 


k ——oo 


-z dX ^= £ kx[kY 

k——oo 


-k 


dz 


This represents the transform of nx[n]. 


Scaling: The scaling property follows from the transform of y[n\ = a n x[n], to yield 


Y ( z ) = a k x[k]z k = &[*;](= a(^) 


(4.8) 


k =—oo 


k=—oo 


If the ROC of X(z) is \z\ > \K\, the scaling property changes the ROC of Y(z) to | 2 1 > \Ka\. In particular, 
if a = —1, we obtain the useful result (—1 ) n x[n] <= | ZT | => X(—z). This result says that if we change the 
sign of alternating (odd indexed) samples of x[n\ to get y[n], its 2 -transform Y(z) is given by Y(z) = X(—z) 
and has the same ROC. 
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REVIEW PANEL 4.5 


The Scaling Property: a n x[n] <= ZT => X(z/a) and ( 

-1 ) n x[n] <=\ zt =» X(-z) 


DRILL PROBLEM 4.6 

(a) Let X(z) = 2 — 3z~ 2 . Find the 2 -transform of y[n] = (2 ) n x[n] and its ROC. 

(b) Let G{z) = — \z\ > 0.5. Find the 2 -transform of h[n] = (—0.5) n <7[n] and its ROC. 

(c) Let F(z) = 2 + 5 2 _1 — 4 z~ 2 . Find the 2 -transform of p[n\ = — f[n ] and its ROC. 

Answers: (a) 2 — 12z~ 2 , z ^ 0 (b) ---, \z\ > 0.25 (c) 2 — 5 2 _1 — 4z -2 , z ^ 0 

If x[n\ is multiplied by or (e jT2 )", we then obtain the pair e^ nQ x[n] 4= | zt | => X(ze~i n ). An 
extension of this result, using Euler’s relation, leads to the times-cos and times-sin properties: 

cos(nn)x[n] = 0.5x[n](e jnn + e- jnn ) 4=[zt]=>. 0.5 [X(ze? n ) + X(ze~ jn )] (4.9) 

sin(nfl)x[n] = -j0.5x[n](e? nCl - e~ jnn ) j0.5[X(ze jn ) - X(ze~ jn )] (4.10) 

The ROC is not affected by the times-cos and time-sin properties. 


DRILL PROBLEM 

(a) Let X(z) = Z , 

z — 1 

(b) Let G{z) = — : — 

z — 0.5 


Answers: (a) Y(z) = 


4.7 


\z\ > 1. Find the 2 -transform of y[n] = cos(0.5n7r)a:[n] and its ROC. 

, | 2 | > 0.5. Find the 2 -transform of h[n] = sin(0.5?i7r)^[?r] and its ROC. 

0.52 


2 2 + l’ 


> 1 (b) H(z) = 


0.25 


, 1 2 1 > 0.5 


Convolution: The convolution property is based on the fact that multiplication in the time domain cor¬ 
responds to convolution in any transformed domain. The 2 -transforms of sequences are polynomials, and 
multiplication of two polynomials corresponds to the convolution of their coefficient sequences. This property 
finds extensive use in the analysis of systems in the transformed domain. 


REVIEW PANEL 4.6 

The Convolution Property: x[n] * h[n] <= | zt | => X(z)H(z) 


Folding: With x[n 


ZT 


X ( 2 ) and y[n\ = x[—n], we use k —k in the defining relation to give 

OO OO OO 

Y{z)= Y, x[~k}z- k = E x ^ zk = E x[k}(l/z)- k =X(l/z) (4.11) 

k ——00 k =—00 k ——00 

If the ROC of x[n] is \z\ > |a|, the ROC of the folded signal x[—n\ becomes 11/2| > |a| or | 2 | < l/|a|. 



REVIEW PANEL 4.7 


The Folding Property of 

x[—n] <= zt 

the Two-Sided 2 - Transform 

\=> X(1 /z) (the ROC changes from 

M > a to 1 2 1 < l/\a\) 
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DRILL PROBLEM 4.8 

(a) Let X(z) = 2 + 3 2 _1 , z ^ 0. Find the 2 -transform of y[n] = x[—n] and its ROC. 

z 

(b) Let G{z) = —, \ z \ > 0-5- Find the 2 -transform of h[n] = g[—n] and its ROC. 

Z U.O 

Answers: (a) Y(z) = 32 + 2, \z\ ^ oo (b) H(z ) = -— , \z\ < 2 

1 — 0.02 


The Folding Property and Symmetric Signals 

The folding property is useful in checking for signal symmetry from its 2 -transform. For a signal x[n\ that 
has even symmetry about the origin n = 0, we have x[n] — x[—n], and thus X(z) = X(l/z). Similarly, if 
x[n] has odd symmetry about n = 0, we have x[n] = x[—n\, and thus X(z) = —X(l/z). If x\n] is symmetric 
about its midpoint and the center of symmetry is not n = 0, we observe that X(z) = z M X(\/z) for even 
symmetry and X(z) = — z M X(l/z ) for odd symmetry. The factor z M , where M is an integer, accounts for 
the shift of the center of symmetry from the origin. 


REVIEW PANEL 4.8 

A Property of the 2 - Transform of Symmetric Sequences 

Even symmetry: x[n] = x[—n] X(z) = z M X(l/z) Odd symmetry: x[n] = — x[—n] X(z) = 
— z M X (1 / 2 ) 


DRILL PROBLEM 4.9 



(a) Let x[n] 

r 4 

= {o, 

1 . 

5, 1}. 

Show that X(z) 

= z M X(l/z) and find M. 

(b) Let y[n] 

= {2, 

4. 

2 } 

. Show 

that Y(z) = z M 

Y(l/z) and find M. 

(c) Let g[n\ 

= {3, 

4 

0 , 

—2}. Show that G(z) = 

-- -z M G{l/z) and find M. 

Answers: ( 

a) M 

= - 

-4 

(b) M = 1 

(c) M = 0 


The Folding Property and Anti-Causal Signals 

The folding property is also useful in finding the transform of anti-causal signals. From the causal signal 
X ( 2 ) (with ROC \z\ > |a|), we find the transform of x[—n]u[—n] as X(l/ 2 ) (whose ROC 


ZT 


is \z\ < l/|a|). The anti-causal signal y[n] = x[—n\u[—n — 1] (which excludes the sample at n = 0) can then 
be written as y[n] = x[—n\u[—vt\ — x[0]5[n], as illustrated in Figure 4.2. 


■x [//] u [n] 




Figure 4.2 Finding the 2 -transform of an anti-causal signal from a causal version 


(c)Ashok Ambardar, September 1, 2003 





4.2 Properties of the Two-Sided z -Transform 


133 


With x[n]u[n] += zt => X(z), \z\ > |a|, the 2 -transform of y[n\ = x[—n}u[—n — 1] gives 


y[n] = x[—n]u[—n — 1] 4=| zt [=>■ Y ( 2 ) = X(l/z) — x[0], \z\ < l/|a| 


(4.12) 


REVIEW PANEL 4.9 

Its Right-Sided Version 

zt => X(l/z) — x[0], 1 2 1 < 1/|a|. 

How to Find the 2 -Transform of a Left-Sided Signal from 

If x[n]u[n] 4= ZT => X ( 2 ) , 2 > a , then x[—n]u[—n— 1] ■<=[ 

1 ,-, 1 


DRILL PROBLEM 4.10 


(a) Let x[n]u[n] += | ZT | => 2 + 5 z \ z ^ 0. Find the 2 -transform of y[n] = x[—n]u[—n — 1] and its ROC. 

(b) Let f[n]u[n\ +=| ZT |=> -——, \z\ > 0.5. Find the 2 -transform of g[n] = f[—n\u[—n— 1] and its ROC. 


z — 0.5 


0.52 


Answers: (a) Y(z) = 5 2 , \z\ ^ oo (b) Giz) = ——, \z I < 2 

0.52: + 1 


EXAMPLE 4.3 ( 2 -Transforms Using Properties) 

(a) Using the times-?r property, the 2 -transform of y[n] = nu[n\ is 

d 


Y(z) = -2 


dz 


z 


r -2 11 

z 

_z — 1 _ 

— —z 

( 2 - 1) 2 2 — 1 _ 

~ [z- l) 2 


(b) With x[n] = a n nu[n], we use scaling to obtain the 2 -transform: 

2 /a za 


X(z) = 


[( 2 /a) - l] 2 (2 - a) 2 


(c) We find the transform of the iV-sample exponential pulse x[n] = a n (u[n] — u[n — A]). We let y[n] 
u[n] — u[n — N], Its 2 -transform is 

1 - z~ N 

y(z) = z—~■> n^i 

l — z 1 

Then, the ^-transform of x[n\ = a n y[n] becomes 

1 —( 2 /a) 1 


(d) The 2 -transforms of x[n] = cos(?rf2)w[n] and y[n] — sin(nf2)it[n] are found using the times-cos and 
times-sin properties: 


X ( 2 ) = 0.5 


Y(z) = j0.5 


ze 


,jQ 


ze 


-jQ 


e — 1 ze~i Q — 1 


ze 




ze 


-jn 


zei- 1 — 1 ze ~— 1 


2 2 — 2 COS f2 
2 2 — 22 COS + 1 

2 sin0 

2 2 — 22 COS 12 + 1 
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(e) The ^-transforms of f[n\ = a n cos(?iQ)u[n\ and g[n] = a n sin(nfl)u[n] follow from the results of part 
(d) and the scaling property: 


F{z) = 

G(z) = 


(. z/a) 2 — ( 2 /a)cosfi 


z 2 — az cos O 


{z/a) 2 — 2(z/a)cosfl + 1 z 2 — 2 a 2 cosfi + a 2 
( 2 /a)sinfi a 2 sin 


{z/a) 2 — 2 ( 2 /a)cosfi + 1 z 2 — 2azcosfl + a 2 


(f) We use the folding property to find the transform of y[n] = a n u[—n — 1]. We start with the transform 

z/{z — a), ROC: |d > |a|. With x[0] = 1, we find 


pair x[n\ = a u[n\ 


ZT 


y[n] = a n, u[—n — 1 ] 


ZT 


X{l/z) - a:[0] = 


i/ 2 i aZ I I 1 

YT - 1= i-> R°C: \z\ < t r 

1/z — a 1 — az |a| 


If we replace a by 1/a, and change the sign of the result, we get 

z 


—a n u[—n — 1] 


ZT 


ROC: Id < |a| 


This is listed as a standard transform pair in tables of ^-transforms. 


(g) We use the folding property to find the transform of x[n] = a^ n I, |a| < 1 (a two-sided decaying 
exponential). We write this as x[n] = a n u[n] + a~ n u[n ] — S [n] (a one-sided decaying exponential and 
its folded version, less the extra sample included at the origin), as illustrated in Figure E4.3G. 



Its 2 -transform then becomes 


X{z) = 


l/z 


z — a 


( 1 / 2 ) ~ 


- 1 = 


2 - (1/a) : 


ROC: |a| < \z\ < -—r 
a 


Note that the ROC is an annulus that corresponds to a two-sided sequence, and describes a valid region 
only if |a| < 1. 


4.3 Poles, Zeros, and the z-Plane 

The 2 -transform of many signals is a rational function of the form 

, . _ N{z) _ Bmz m + Bm~iz m 1 + • • • + B2Z 2 + B\z + Bo 
D{z) A n z n + AAr_i2 iV ^ 1 + • • • + A 2 z 2 + A\z + A 0 
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Denoting the roots of N(z) by 2 ,, i = 1, 2,..., M and the roots of D(z) by pk, k = 1,2,..., N, we may also 
express X(z) in factored form as 


X(z) = A® = y («-nK»-^)-(»-» W ) 

D(z) (z - pi)(z - p 2 ) ■ • • (z - p N ) 


(4.14) 


The roots of N(z) are termed zeros and the roots of D(z) are termed poles. A plot of the poles (shown 
as x) and zeros (shown as o) in the 2 -plane constitutes a pole-zero plot, and provides a visual picture of 
the root locations. For multiple roots, we indicate their multiplicity next to the root location on the plot. 
Clearly, we can also find X ( 2 ) in its entirety from a pole-zero plot of the root locations but only if the value 
of the multiplicative constant K is also displayed on the plot. 


EXAMPLE 4.4 (Pole-Zero Plots) 

(a) Let H(z)= 22(2 + 1) 


(2- |)(2 2 + i)(2 2 + 42 + 5)' 

The numerator degree is 2. The two zeros are 2 = 0 and 2 = — 1. 

The denominator degree is 5. The five finite poles are at 2 = |, 2 = and 2 = — 2 ± j. 
The multiplicative factor is K = 2. The pole-zero plot is shown in Figure E4.4(a). 




Figure E4.4 Pole-zero plots for Example 4.4(a and b) 


(b) What is the 2 -transform corresponding to the pole-zero pattern of Figure E4.4(b)? Does it represent a 
symmetric signal? 

If we let X(z) = KN(z)/D(z), the four zeros correspond to the numerator N(z) given by 
N(z) = (2 - j0.5)(2 + j2)(z + j'0 .5)(2 - j'2) = z 4 + 4.25 2 2 + 1 


The two poles at the origin correspond to the denominator D(z) = z 2 . With K = 1, the 2 -transform 
is given by 


X ( 2 ) = K 


N(z) _ z 4 + 4.25 2 2 + 1 
D(z) ~ ^ 


= 2 


4.25 


Checking for symmetry, we find that X(z) = X(l/z), and thus x[n] is even symmetric. In fact, 


x[n} = S[n + 2] + 4.25<5[n] + S[n — 2] = {1, 4.25, 1}. We also note that each zero is paired with its 
reciprocal (j0.5 with —j 2, and —j0.5 with j 2), a characteristic of symmetric sequences. 
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4.4 The Transfer Function 

The response y[n] of a system with impulse response h[n], to an arbitrary input x[n], is given by the 
convolution y[n] = x[n] * h[n\. Since the convolution operation transforms to a product, we have 

Y(z) = X(z)H(z) or H(z) = ^ (4.15) 

The time-domain and 2 -domain equivalence of these operations is illustrated in Figure 4.3. 


Input x[n] 


System 

impulse response = h[n] 


Output y[n] = x[n]*h[n] = h[n]*x[n] 
Output = convolution of x[n] and h[n] 


Input X(z) 

System 

Output Y(z) = H(z)X(z) 


transfer function = H(z) 

Output = product of H(z) and X(z) 


Figure 4.3 System description in the time domain and 2 -domain 


The transfer function is defined only for relaxed LTI systems , either as the ratio of the output Y ( 2 ) and 
input X(z), or as the 2 -transform of the system impulse response h[n]. 

A relaxed LTI system is also described by the difference equation: 


y[n] + A\y[n — 1] + • • • + A^y[n — N] = Box[n] + B\x[n — 1] + • • • + Bmx[u — M] (4.16) 


Its 2 -transform results in the transfer function: 

, , _ Y(z) _ Bq + B\z 1 + • • • + Bmz m 
{Z) ~ X(z) ~ 1 + A 1 z~ 1 + --- + A N z~ N 


(4.17) 


The transfer function is thus a ratio of polynomials in z. An LTI system may be described by its transfer 
function, its impulse response, its difference equation or its pole-zero plot and given one form, it is possible 
to obtain any of the other forms. 


REVIEW PANEL 4.10 


The Transfer Function of Relaxed LTI Systems Is a Rational Function of 2 

Y ( 2 ) (transformed output) 


H{z) = 


X ( 2 ) (transformed input) 


H{z) = Z{h[n]} ( 2 -transform of impulse response) 


DRILL PROBLEM 4.11 


(a) Find the transfer function of the digital filter described by y[n] — 0Ay[n — 1] == 2 x[n}. 

z — 1 

(b) Find the difference equation of the digital filter described by H(z) = ~ ^ ^ . 

(c) Find the difference equation of the digital filter described by h[n] = (0.5)”'u[n] — <5[n]. 

22 


Answers: (a) H{z) = 


2-0.4 


(b) y[n\+0.5y[n — 1] = x[n]—x[n— 1] (c) y[n] — 0.5y[n— 1] = 0.5x[n — 1] 
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The poles of a transfer function H(z) are called natural modes or natural frequencies. The poles of 
Y(z) = H(z)X(z) determine the form of the system response. Clearly, the natural frequencies in H(z ) will 
always appear in the system response, unless they are canceled by any corresponding zeros in X(z). The 
zeros of H(z) may be regarded as the (complex) frequencies that are blocked by the system. 


4.5 Interconnected Systems 

The ^-transform is well suited to the study of interconnected LTI systems. Figure 4.4 shows the intercon¬ 
nection of two relaxed systems in cascade and in parallel. 


X(z) 


Two LTI systems in cascade 
Y(z) 


Hi(z) 


H 2 (z) 


Equivalent LTI system 

=> *<z) 


H x ( z)H 2 (z) 


Y(z) 


Two LTI systems in parallel 
X(z) 



Y(z) 


Equivalent LTI system 
=> X(z) 


H x (z)+H 2 (z) 


Y(z) 


Figure 4.4 Cascade and parallel systems and their equivalents 


The overall transfer function of a cascaded system is the product of the individual transfer functions. 
For n systems in cascade, the overall impulse response hc[n\ is the convolution of the individual impulse 
responses h\ [n], h -2 [n]..... Since the convolution operation transforms to a product, we have 

Hc{z) = Hi(z)H 2 {z) ■ ■ ■ H n (z ) (for n systems in cascade) (4-18) 

We can also factor a given transfer function H(z) into the product of first-order and second-order transfer 
functions and realize H{z) in cascaded form. 

For systems in parallel, the overall transfer function is the sum of the individual transfer functions. For 
n systems in parallel, 

Hp(z) = H\(z) + H 2 (z) H-+ H n (z) (for n systems in parallel) (4.19) 

We can also use partial fractions to express a given transfer function H(z) as the sum of first-order and/or 
second-order subsystems, and realize H(z) as a parallel combination. 


| REVIEW PANEL 4.11 | 

Overall Impulse Response and Transfer Function of Systems in Cascade and Parallel 
Cascade: Convolve individual impulse responses. Multiply individual transfer functions. 
Parallel: Add individual impulse responses. Add individual transfer functions. 
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EXAMPLE 4.5 (Systems in Cascade and Parallel) 

(a) Two digital filters are described by h-\ [n\ = a n u[n ] and h 2 [n] = (— a) n u[n]. The transfer function of 
their cascade is Hc{z) and of their parallel combination is Hp(z). How are Hq{z) and Hp{z ) related? 

z z 

The transfer functions of the two filters are H\{z) = - and H 2 (z) = -. Thus, 


H c {z) = H^Hziz) = 


H P (z) = H 1 (z) + H 2 (z) = 


2z 2 


So, H P {z) = 2 H c (z). 


(b) Is the cascade or parallel combination of two linear-phase filters also linear phase? Explain. 
Linear-phase filters are described by symmetric impulse response sequences. 

The impulse response of their cascade is also symmetric because it is the convolution of two symmetric 
sequences. So, the cascade of two linear-phase filters is always linear phase. 

The impulse response of their parallel combination is the sum of their impulse responses. Since the 
sum of symmetric sequences is not always symmetric (unless both are odd symmetric or both are even 
symmetric), the parallel combination of two linear-phase filters is not always linear phase. 


DRILL PROBLEM 4.12 | 

4 

(a) Find the transfer function of the parallel connection of two filters described by h\ [n] = {l, 3} and 
h 2 [n] = { 2, -1}. 

(b) The transfer function of the cascade of two filters is Hc{z) = 1. If the impulse response of one filter 
is hi[n) = 2(0.5) n u[?r], find the impulse response of the second. 

(c) Two filters are described by y[n] — 0.4y[?r — 1] = x[n\ and h 2 [n] = 2(0.4)”w[n]. Find the transfer 
function of their parallel combination and cascaded combination. 

Answers: (a) 2,2 + 32 -1 (b) {0.5, -0.25} (c) H P (z ) = —, H c {z) = -— 2 " 

2 — 0.4 (z — 0A) Z 


4.6 Transfer Function Realization 

The realization of digital filters described by transfer functions parallels the realization based on difference 
equations. The nonrecursive and recursive filters described by 

H N (z) = B 0 + Ri 2 _1 +-1 - B m z~ m y[n) = B 0 x[n] + Bix[n - 1] +- \-B M x[n-M\ (4.20) 

h r(z) = i + ^ 4 1 --i + 1 .. + ^ a ,— n 2/W = - A M n - !]- A NV[n - A] + x[n] (4.21) 

can be realized using the feed-forward (nonrecursive) structure and feedback (recursive) structure, as 
shown in Figure 4.5. 

Now, consider the general difference equation 

y[n) = —Aiy[n — !] — ••• — Apfy[n — N] + Box[n\ + Bix[n — 1] + • • • + Bpix[n — A] (4.22) 
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Figure 4.5 Realization of a nonrecursive (left) and recursive (right) digital filter 


We choose M = N with no loss of generality, since some of the coefficients Bk may always be set to zero. 
The transfer function (with M = N ) then becomes 


H{z) = 


B 0 + Biz 1 + • • • + 


1 + A 1 z~ 1 + A 2 z~ 2 H-b 


B n z~ n 
• T A.mz 


^ = H n {z)H r {z) 


The transfer function H{z) = Hjy(z)H R (z) is the product of the transfer functions of a recursive and a 
nonrecursive system. Its realization is thus a cascade of the realizations for the recursive and nonrecursive 
portions, as shown in Figure 4.6(a). This form describes a direct form I realization. It uses 2N delay 
elements to realize an fVth-order difference equation and is therefore not very efficient. 



Figure 4.6 Direct form I (left) and canonical, or direct form II (right), realization of a digital hlter 


Since LTI systems can be cascaded in any order, we can switch the recursive and nonrecursive parts to get 
the structure of Figure 4.6(b). This structure suggests that each pair of feed-forward and feedback signals 
can be obtained from a single delay element instead of two. This allows us to use only N delay elements 
and results in the direct form II, or canonic, realization. The term canonic implies a realization with the 
minimum number of delay elements. 
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If M and N are not equal, some of the coefficients (A*, or Bk) will equal zero and will result in missing 
signal paths corresponding to these coefficients in the filter realization. 


REVIEW PANEL 4.12 

Digital Filter Realization 

FIR: No feedback paths HR: Both feed-forward and feedback paths 


4.6.1 Transposed Realization 

The direct form II also yields a transposed realization if we turn the realization around (and reverse the 
input and input), replace summing junctions by nodes (and vice versa), and reverse the direction of signal 
flow. Such a realization is developed in Figure 4.7. 



Figure 4.7 Direct form II (left) and transposed (right) realization of a digital filter 


EXAMPLE 4.6 (Direct Form II and Transposed Realizations) 

Consider a system described by 2 y[n] — y[n — 2] — 4y[n — 3] = 3a; [n — 2]. Its transfer function is 


H{z) 


2 - 


3z~ 2 

z~ 2 - 4z~ 3 


1.5 z 

z 3 — 0.5z — 2 


This is a third-order system. To sketch its direct form II and transposed realizations, we compare H{z) with 
the generic third-order transfer function to get 

, . _ B 0 z 3 + Biz 2 + B 2 z + B 3 
(Z) ~ z 3 + A,z 2 + A 22 + A 3 

The nonzero constants are B 2 = 1.5, A 2 = —0.5, and A 3 = —2. Using these, we obtain the direct form II 
and transposed realizations shown in Figure E4.6. 
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4.6.2 Cascaded and Parallel Realization 

The overall transfer function of a cascaded system is the product of the individual transfer functions. 

Hc{z) = Hi(z) H 2 {z) ■■■ H n (z) (for n systems in cascade) (4.24) 

As a consequence, we can factor a given transfer function H(z) into the product of several transfer functions 
to realize H{z) in cascaded form. Typically, an iV-th order transfer function is realized as a cascade of 
second-order sections (with an additional first-order section if N is odd). 

For systems in parallel, the overall transfer function is the sum of the individual transfer functions. For 
n systems in parallel, 

Hp(z) = Hi(z) + H 2 {z) H-+ H n (z) (for n systems in parallel) (4-25) 

As a result, we may use partial fractions to express a given transfer function H(z) as the sum of first-order 
and/or second-order subsystems, and realize H(z) as a parallel combination. 


EXAMPLE 4.7 (System Realization) 

z 2 (6z — 2 ) 

(a) Find a cascaded realization for H(z) = - ~ , ~ ,-=—. 

(z-l)(z2-±z-±) 

This system may be realized as a cascade H(z) = Hi(z)H 2 (z), as shown in Figure E4.7A, where 


H^z) 



H 2 {z) 


6^-2 

2-1 
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Figure E4.7A Cascade realization of the system for Example 4.7(a) 


(b) Find a parallel realization for H(z) = 


(z — l)(z — 0.5) 

2z z 


Using partial fractions, we find H(z) = —-A— = H\{z) — H 2 {z). 

z — 1 z — 0.5 


The two subsystems Hi(z) and H 2 (z) may now be used to obtain the parallel realization, as shown in 
Figure E4.7B. 



Figure E4.7B Parallel realization of the system for Example 4.7(b) 


4.7 Causality and Stability of LTI Systems 

In the time domain, a causal system requires a causal impulse response h[n\ with h[n\ = 0,n < 0. If H(z) 
describes the transfer function of this system, the number of zeros cannot exceed the number of poles. In 
other words, the degree of the numerator polynomial in H(z) cannot exceed the degree of the denominator 
polynomial. This means that the transfer function of a causal system must be proper and its ROC must be 
outside a circle of finite radius. 

For an LTI system to be BIBO (bounded-input, bounded-output) stable, every bounded input must 
result in a bounded output. In the time domain, BIBO stability of an LTI system requires an absolutely 
summable impulse response h [n\. For a causal system, this is equivalent to requiring the poles of the transfer 
function H(z) to lie entirely within the unit circle in the 2 -plane. This equivalence stems from the following 
observations: 

Poles outside the unit circle (|z| > 1) lead to exponential growth even if the input is bounded. 

Example: H{z) = z/{z — 3) results in the growing exponential (3)”u[n]. 
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Multiple poles on the unit circle always result in polynomial growth. 

Example: H(z) = 1 j\z(z — l) 2 ] produces a ramp function in h[n\. 

Simple (non-repeated) poles on the unit circle can also lead to an unbounded response. 

Example: A simple pole at z = 1 leads to H(z) with a factor zj(z — 1). If X(z) also contains a pole at z = 1, 
the response Y(z) will contain the term z/(z — l) 2 and exhibit polynomial growth. 

None of these types of time-domain terms is absolutely summable, and their presence leads to system 
instability. Formally, for BIBO stability, all the poles of H(z) must lie inside (and exclude) the unit circle 
\z\ = 1. This is both a necessary and sufficient condition for the stability of causal systems. 

If a system has simple (non-repeated) poles on the unit circle, it is sometimes called marginally stable. 
If a system has all its poles and zeros inside the unit circle, it is called a minimum-phase system. 

4.7.1 Stability and the ROC 

For any LTI system, causal or otherwise, to be stable, the ROC must include the unit circle. The various 
situations are illustrated in Figure 4.8. 




ROC (shaded) of 
causal, stable system 


ROC (shaded) of 
anti-causal, stable system 


ROC (shaded) of 
two-sided, stable system 


Figure 4.8 The ROC of stable systems (shown shaded) always includes the unit circle 


The stability of a causal system requires all the poles to lie inside the unit circle. Thus, the ROC includes 
the unit circle. The stability of an anti-causal system requires all the poles to lie outside the unit circle. 
Thus, the ROC once again includes the unit circle. Similarly, the ROC of a stable system with a two-sided 
impulse response is an annulus that includes the unit circle and all its poles lie outside this annulus. The 
poles inside the inner circle of the annulus contribute to the causal portion of the impulse response while 
poles outside the outer circle of the annulus make up the anti-causal portion of the impulse response. 


REVIEW PANEL 4.13 

The ROC of Stable LTI Systems Always Includes the Unit Circle 

Stable, causal system: All the poles must lie inside the unit circle. 

Stable, anti-causal system: All the poles must lie outside the unit circle. 

Stability from impulse response: h[n\ must be absolutely summable (X]IM^]I < oo). 


EXAMPLE 4.8 (Stability of a Recursive Filter) 

(a) Let H(z) = —-—. 

z — a 

If the ROC is \z\ > |a|, its impulse response is h[n) = a n u[n], and the system is causal. 
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For stability, we require |a| < 1 (for the ROC to include the unit circle). 


% 

(b) Let H(z) = -, as before. 

z — a 

If the ROC is |z| < |a|, its impulse response is h[n] = — a n u[—n — 1], and the system is anti-causal. 
For stability, we require |a| > 1 (for the ROC to include the unit circle). 


DRILL PROBLEM 4.13 


2 Z + 1 

(a) Is the filter described by H(z) = 7 -,. 

(z — 0.5)(z + 0.5) 

2z + 1 

(b) Is the filter described by H(z) = - -- . 

(z — 1.5) (z + 0.5) 

2z +1 

(c) Is the filter described by H(z) = 7 -V;- 

(z- 1.5)(z + 0.5) 

Answers: (a) Stable, causal (b) Unstable, causal 


\z\ > 0.5 stable? Causal? 

| z\ > 1.5 stable? Causal? 

0.5 < \z\ < 1.5 stable? Causal? 
(c) Stable, two-sided 


4.7.2 Inverse Systems 

The inverse system corresponding to a transfer function H(z) is denoted by H~ 1 (z), and defined as 

H-\z) = H I {z) = 1 ^- ) (4.26) 

The cascade of a system and its inverse has a transfer function of unity: 

H c {z) = H(z)H~ 1 {z) = 1 h c [n) = <5[n] (4.27) 

This cascaded system is called an identity system, and its impulse response equals hc[n] = 5 [n]. The 
inverse system can be used to undo the effect of the original system. We can also describe hc[n] by the 
convolution h[n] * hi[n]. It is far easier to find the inverse of a system in the transformed domain. 

| REVIEW PANEL 404] 

Relating the Impulse Response and Transfer Function of a System and Its Inverse 

If the system is described by H(z) and h[n] and its inverse by Hj(z) and hj[n], then 

H(z)Hi(z) = 1 h[n] * hi[n] = <5[n] 


EXAMPLE 4.9 (Inverse Systems) 

(a) Consider a system with the difference equation y[n] + ay[n — 1] = x[n] + /3x[n 
To find the inverse system, we evaluate H(z) and take its reciprocal. Thus, 


H{z) 


1 + Pz - 1 
1 + az~ 1 


Hi{z) 


1 

W?) 


1 + az 1 
l + pz- 1 


!]• 


The difference equation of the inverse system is y[n] + f3y[n — 1] = x[n] + ax[n — 1], Note that, in 
general, the inverse of an HR filter is also an HR filter. 
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(b) Consider an FIR filter whose system equation is y[n] = x[n\ + 2x[n — 1] + 3 x[n — 2], 
To find the inverse system, we evaluate H(z) and take its reciprocal. Thus, 


H(z) = 1 + 2Z- 1 +3z~ 2 


Hj(z) 


1 

W) 


1 

1 + 2z~ 1 + 3z~ 2 


The difference equation of the inverse system is y[n] + 2y[n — 1] + 3y[n — 2] = x[n\. Note that the 
inverse of an FIR filter is an HR filter. 


DRILL PROBLEM 4.14 


(a) The inverse of an FIR filter is always an HR filter. True or false? If false, give a counterexample. 

(b) The inverse of an HR filter is always an FIR filter. True or false? If false, give a counterexample. 


Answers: (a) True 


2 - 0.4 

(b) False. For example, the inverse of H(z) = - is also HR. 

z — 0.5 


4.8 The Inverse z-Transform 

The formal inversion relation that yields x[n ] from X(z) actually involves complex integration and is described 

by 

adnl = —(f X(z)z n ~ 1 dz (4.28) 

j2tt J r 

Here, T describes a clockwise contour of integration (such as the unit circle) that encloses the origin. Eval¬ 
uation of this integral requires knowledge of complex variable theory. In this text, we pursue simpler 
alternatives, which include long division and partial fraction expansion. 

4.8.1 Inverse z-Transform of Finite Sequences 

For finite-length sequences, X(z) has a polynomial form that immediately reveals the required sequence x[n]. 
The ROC can also be discerned from the polynomial form of X(z). 


EXAMPLE 4.10 (Inverse Transform of Sequences) 

(a) Let X(z) = 3 2 _1 + 5 z~ 3 + 2z~ 4 . This transform corresponds to a causal sequence. We recognize x[n] 
as a sum of shifted impulses given by 

x[n] = 3(5[n — 1] + 5i5[n — 3] + 2i5[n — 4] 

4 

This sequence can also be written as x[n\ = {0, 3, 0, 5, 2}. 


(b) Let X(z) = 2 z 2 — 5z + 5z 1 — 2 z 2 . This transform corresponds to a noncausal sequence. Its inverse 
transform is written, by inspection, as 

x[n\ = {2, -5, 0, 5, —2} 

Comment: Since X(z) = —X(l/z), x[n ] should possess odd symmetry. It does. 
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4.8.2 Inverse ^-Transform by Long Division 

A second method requires X(z) as a rational function (a ratio of polynomials) along with its ROC. For a 
right-sided signal (whose ROC is \z\ > |a|), we arrange the numerator and denominator in ascending powers 
of z, and use long division to obtain a power series in decreasing powers of z, whose inverse transform 
corresponds to the right-sided sequence. 

For a left-sided signal (whose ROC is \z\ < |a|), we arrange the numerator and denominator in descending 
powers of z, and use long division to obtain a power series in increasing powers of z, whose inverse transform 
corresponds to the left-sided sequence. 

This approach, however, becomes cumbersome if more than just the first few terms of x[n\ are required. 
It is not often that the first few terms of the resulting sequence allow its general nature or form to be 
discerned. If we regard the rational 2 -transform as a transfer function H(z) = P(z)/Q(z), the method of 
long division is simply equivalent to finding the first few terms of its impulse response recursively from its 
difference equation. 


REVIEW PANEL 4.15 

Finding Inverse Transforms of X(z) = N(z)/D(z) by Long Division 

Right-sided: Put N(z), D(z) in ascending powers of z. Obtain a power series in decreasing powers of z. 
Left-sided: Put N(z), D(z) in descending powers of z. Obtain a power series in increasing powers of 2 . 


EXAMPLE 4.11 (Inverse Transforms by Long Division) 

z — 4 

(a) We find the right-sided inverse of H{z) = - -y. 

1 — z -\- z z 

We arrange the polynomials in descending powers of 2 and use long division to get 

2 — 1 - 3z~ 2 - 4 z~ 3 ■■ ■ 
z 2 -z + 1) z 4 

2 — 1 + 2 _1 
- 3 - 2- 1 

— 3 + 32 _1 — 32 -2 
- 42- 1 + 32-2 

- 42“ 1 + 42“2 - 4 z~ 3 
- 2" 2 + 42- 3 


This leads to H(z) = z 1 — 3 2 2 — 42 3 + • • •. The sequence h[n] can be written as 

h[n] = S(n — 1) — 3<5[n — 2] — 4 S[n — 3] + • • • or h[n] = {0, 1, —3, —4, ...} 


(b) We could also have found the inverse by setting up the the difference equation corresponding to 
H(z) = Y(z)/X(z), to give 

y[n] — y[n — 1] + y[n — 2] = x[n — 1] — 4 x[n — 2] 
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With x[n] = (5[n], its impulse response h[n] is 

h[n] — h[n — 1] + h[n — 2] = <J[n] — 4 5[n — 2] 

With h[— 1] = h[— 2] = 0, (a relaxed system), we recursively obtain the first few values of h[n] as 

n = 0: h[0] = /i[-l]-/i[-2]+5[-l]-4<y[-2]= 0-0 + 0-0 = 0 

n=l: h[ 1] = h[0] - h[-l] + tf[0] - 4<5[-l] = 0 - 0 + 1 - 0 = 1 

7i = 2 : h[ 2 ] = h[l] - /i[ 0 ] + S[l] - 4J[0] = 1 - 0 + 0 - 4 = -3 

7i = 3: h[ 3] = h[ 2] - h[ 1] + 6[2] - 4<5[1] =-3-1 + 0 + 0 =-4 

These are identical to the values obtained using long division in part (a). 


(c) We find the left-sided inverse of H(z) = 


2-4 


1 — z + z 2 

We arrange the polynomials in descending powers of 2 and use long division to obtain 

—4 — 32 + 2 2 * * * 

1 - 2 + 2 2 )—4 + 2 

-4 + 42 - 42 2 
- 32 + 42 2 

-32 + 32 2 - 32 3 
2 2 + 32 3 

2 2 — 2 3 + 2 4 


42 3 - 2 4 


Thus, H(z ) = —4 — 32 + 2 2 + • • •. The sequence h[n] can then be written as 

h[n] = —45[n\ — 3 S[n + 1] + 6[n + 2 ] + • • • or h[n\ = {..., 1 , —3, — 4} 


(d) We could also have found the inverse by setting up the the difference equation in the form 

h[n — 2 ] = h[n — 1 ] + 8[n — 1 ] — 4S[n — 2 ] 

With h[ 1] = h[ 2] = 0, we can generate /i[0], h[— 1], h{— 2],..., recursively, to obtain the same result as 
in part (c). 


DRILL PROBLEM 4.15 


(a) Let H{z) = 


2-4 


1 2 1 > 1. Find the first few terms of h[n] by long division. 


2 2 + l’ 
z — 4 

(b) Let H(z) = --, 1 2 1 < 2. Find the first few terms of h[n] by long division. 

+ -r 4 

Answers: (a) {0, 1 , -4, -1, 4,...} (b) {..., -0.6250, 0.25, 0.25, -1} 
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4.8.3 Inverse Transform from Partial Fractions 

A much more useful method for inversion of the 2 -transform relies on its partial fraction expansion into terms 
whose inverse transform can be identified using a table of transform pairs. This is analogous to finding inverse 
Laplace transforms, but with one major difference. Since the 2 -transform of standard sequences in Table 4.1 
involves the factor 2 in the numerator, it is more convenient to perform the partial fraction expansion for 
Y(z) = X(z)/z rather than for X(z). We then multiply through by 2 to obtain terms describing X(z) in a 
form ready for inversion. This also implies that, for partial fraction expansion, it is Y(z) = X(z)jz and not 
X ( 2 ) that must be a proper rational function. The form of the expansion depends on the nature of the poles 
(denominator roots) of Y(z). The constants in the partial fraction expansion are often called residues. 


Distinct Linear Factors 


If Y ( 2 ) contains only distinct poles, we express it in the form: 

YU) = __ = -2+ + _*L_ 4 

{z + Pl){z + P2) ■ ■ ■ (z + p N ) 2+Pi Z + P2 

To find the mth coefficient K m , we multiply both sides by (2 + p rn ) to get 


Kn 
z + Pn 


(z + Pm)Y(z) = K\ 


(z + Pm) 


(2 + p m ) 

(z + p N ) 


1 ± ilt ) - 1 “1 / | \ I 1 “m 1 I “IV / \ v 

[z+p 1 ) (z + p N ) 

With both sides evaluated at 2 = — p m , we obtain K rn as 

K m = (z + p m )Y(z) (4.31) 

Z=~Pm 

In general, Y ( 2 ) will contain terms with real constants and terms with complex conjugate residues, and may 
be written as 


Y(z) = 


Z+pi Z+p 2 


z + r i 2 + rT 2 + ?’2 z + rn 


For a real root, the residue (coefficient) will also be real. For each pair of complex conjugate roots, the 
residues will also be complex conjugates, and we thus need compute only one of these. 


Repeated Factors 

If the denominator of Y(z) contains the repeated term ( z + r) k , the partial fraction expansion corresponding 
to the repeated terms has the form 

Y ( 2 ) = (° ther terms ) + ^+° r)fc + ( z + r) k ~ 1 + " ' + 7+7 (4 ' 33) 

Observe that the constants Aj ascend in index j from 0 to fc — 1, whereas the denominators ( z + r) n descend 
in power n from k to 1. Their evaluation requires (2 + r) k Y ( 2 ) and its derivatives. We successively find 

A 0 = (2 + r) k Y(z) A 2 = ~[(z + r) k Y(z)] 

z=-r dZ z——r M 34 ! 

rl 1 rl n K ' 

M = -[(z + r) k Y(z)\ A n = — [(2 + r) k Y(z)) 

CIZ z=—r n\ dz n z=—r 

Even though this process allows us to find the coefficients independently of each other, the algebra in finding 
the derivatives can become tedious if the multiplicity k of the roots exceeds 2 or 3. Table 4.3 lists some 
transform pairs useful for inversion of the 2 -transform of causal signals by partial fractions. 
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Table 4.3 Inverse z-' Transform of Partial Fraction Expansion (PFE) Terms 


Entry 

PFE Term X{z) 

Causal Signal x[n\, n > 0 

Note 1: Where applicable, K = Ke^ = C + jD 

Note 2: For anti-causal sequences, we get the signal — x[n]u[—n — 1] where x[n] is as listed. 

1 

z 

a n 

z — a 

2 

z 

nQ ,(«- 1 ) 

( 2 -a ) 2 

3 

c a r — -n 

n(n - 1) • • • (n - N + 1) (n _ N) 

(z-a) N + 1 ( } 

N! 

4 

* 

2Ka n cos(nfl + </>) = 2a n [C cos(nfl) — Dsin(nfl)] 

2 — ae )!1 2 — ae 

5 

zK zK* 

1 

2 Ana " -1 cos[(n — l)fl + (j)\ 

(2 — ae ? n ) 2 (2 — ae - -? 0 ) 2 

6 

zK zK* 

I 

2K n(n - 1) - -Jn- N + l) o( „_„, cos|(n m + ^ 

(2 — ae ? n ) JV+1 ( 2 -ae - i °) w + 1 


REVIEW PANEL 4.16 


Partial Fraction Expansion of Y(z) = X(z)/z Depends on Its Poles (Denominator Roots) 


N 


Distinct roots: Y(z) = f~[ 


P(z) 

Z + Pm 


N 


= E 


K„ 


Z + Pm 


where K m = (z + p m )Y(z) | z _ 


Repeated: 


P(z) 

(z + r) k J-J- Z+Pr, 
m =1 


n 


= E 


Krr 


k -1 

+E- 


Z+Pm ' ' (z + r) k 

m =1 n=0 


A ^ r1 n 

where A n = - — [(z + r) Y (*)] 


EXAMPLE 4.12 (Inverse Transform of Right-Sided Signals) 
(a) (Non-Repeated Roots) We find the causal inverse of X(z) = 

X(z) 


(z — 0.25)( 2 : — 0.5) ’ 


We first form Y(z) =-, and expand Y(z) into partial fractions, to obtain 


Y(z) = 


X(z) 


1 


8 16 


0 z(z - 0.25)(z - 0.5) z z — 0.25 2 - 0.5 

Multiplying through by 2 , we get 

I 62 82 


X ( 2 ) = 8 - 


x[n\ = 8<5[n] — 16(0.25) n u[n] + 8(0.5)"u[n] 


2 - 0.25 2 - 0.5 

Its first few samples, a;[0] = 0, x[l] = 0, x[2\ = 1, and x[3] = 0.75 can be checked by long division. 
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Comment: An alternate approach (not recommended) is to expand X(z) itself as 

X(z) = = —4(0-25)"-Mn - 1] + 4(0.5)"“ Mn - 1] 

Its inverse requires the shifting property. This form is functionally equivalent to the previous case. For 
example, we find that cc[ 0 ] = 0 , x[V\ = 0 , ir[ 2 ] = 1 , and x[3] = 0.25, as before. 


(b) (Repeated Roots) We find the inverse of X(z) = 
X(z) 


{ z -m z -2y 


We obtain Y(z) = -, and set up its partial fraction expansion as 

z 


Y(z) = 


X(z) 


1 


A 


K, 


o 


Ad 


0 ( 0 -l) 2 ( 0 - 2 ) z- 2 (z — l ) 2 z-1 

The constants in the partial fraction expansion are 


A = 


1 


(z-iy 


= 1 K 0 = 


1 


z-2 


= -l I<i = 


dz 


1 


0-2 


= -1 


Substituting into Y ( 0 ) and multiplying through by 0 , we get 


X(z) = 


0-2 ( 0 -I ) 2 0-1 


x[n] = (2 ) n u[n] — nu[n] — u[n\ = ( 2 " — n — 1 )u[n\ 


The first few values x[0] = 0, x[l] = 0, a:[2] = 1, a:[3] = 4, and x[4] = 11 can be easily checked by long 
division. 


(c) (Complex Roots) We find the causal inverse of X(z) = 


0 2 -30 


(0 — 2 )( 0 2 — 20 + 2 ) ’ 


We set up the partial fraction expansion for Y(z) = 


X(z) 


as 


Y(z) = 


X(z) 


0 — 3 


A 


I\ 


I<* 


(0 — 2)(0 — 1 — j )(0 — 1 + j) z-2 z-V2e^/ 4 0 — \f2e~^/ A 


We evaluate the constants A and AT, to give 

= 0.7906e- i7156 ° = 0.25 - j0.75 

z=l+j 

Multiplying through by 0 , we get 

_ -0-50 zK zK* 

z-2 + z - \/2e^l A + 0 - y/2e~^l A 

The inverse of the first term is easy. For the remaining pair, we use entry 4 of the table for inversion 
of partial fraction forms with a = \/2, Q = j, K = 0.7906, (f> = —71.56°, to give 


A = 


0 — 3 


0 2 - 20 + 2 


= -0.5 


K = 


0 — 3 


(0 — 2 )( 0 — l+j)\ 


x[n] = —0.5(2)"u[n] + 2(0.7906) (V2) n cos( ? f - 71.56°)u[n] 
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With C = 0.25, D = —0.75, this may also be expressed in the alternate form 

x[n] = -0.5(2)"u[n] + 2(v / 2)"[0.25cos( 7 f) + 0.75sin(*f )]u[n] 


(d) (Inverse Transform of Quadratic Forms) We find the causal inverse of X(z) = 
The numerator suggests the generic form x[n\ = Ba n sin(nfi)u[n] because 


Ba n sin(nfi)w[n] 


ZT 


Bza sinfi 

z 2 — 2za cos fl + a 2 


Comparing denominators, we find that a 2 = 4 and 2a cos fl = 0. Thus, a = ±2. If we pick a = 2, we 
get 4 cos fl = 0 or cos 0 = 0 and thus O = 7 t/2 . 

Finally, comparing numerators, B^asinO = z or B = 0.5. Thus, 


x[n] = Ba n sin(nO)w[n] = 0.5(2)" sin(n7r/2)w[n] 


(e) (Inverse Transform of Quadratic Forms) Let X(z) = 


z 2 -2z + 4 


The quadratic numerator suggests the form x[n] = Aa n cos(nf2)u[n] + Ba n sin(nO)u[n] because 

A(z 2 — za cos fl) „ „ . / r , i-1 Bza sin O 


Aa n cos(nO)u[n] 


ZT 


z 2 — 22a cos fl + a 2 


Ba n sin(nO)u[n] 


ZT 


z 2 — 22a cos O + a 2 


Comparing denominators, we find a 2 = 4 and 2a cos O = 2. Thus, a = ±2. If we pick a = 2, we get 
cos O = 0.5 or O = 7 t/3. 

Now, A(z 2 — za cos O) = A(z 2 — z) and Bza sin O = Bzy/3. We express the numerator of X(z) as 
a sum of these forms to get z 2 + z = (z 2 — z) + 2z = (z 2 — z) + (2/\/3)(z\/3) (with A = 1 and 
B = 2/1/3 = 1.1547). Thus, 

x[n) = Aa n cos(?rO)w[n] + Ba n sin(nO)w[n] = (2)” cos(^)u[n] + 1.1547(2)" sin(^)w[n] 

The formal approach is to use partial fractions. With z 2 — 2z + 4 = (z — 2e J7r / 3 )(2 — 2e - - 77r / 3 ), we find 

X(z) _ 2+1 _ K K* 

z z 2 — 2z + 4 2 — 2ef' 7r / 3 2 — 2e - - 7 ' lr / 3 

We find K = 0.7638c - - 749110 = 0.5 — j'0.5774 and entry 4 of the table for inversion of partial fraction 
forms (with a — 2, fl = ^) gives 

x[n] = 1.5275(2)"cos( 7 f -49.ll°)u[n] = (2)"cos(*f )u[n] + 1.1547(2)"sin(3f)u[n] 

The second form of this result is identical to what was found earlier. 
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4.8.4 The ROC and Inversion 

We have so far been assuming right-sided sequences when no ROC is given. Only when the ROC is specified 
do we obtain a unique sequence from X(z). Sometimes, the ROC may be specified indirectly by requiring 
the system to be stable, for example. Since the ROC of a stable system includes the unit circle, this gives 
us a clue to the type of inverse we require. 


EXAMPLE 4.13 (Inversion and the ROC) 

(a) Find all possible inverse transforms of X(z) 


z 

(z — 0.25)(z — 0.5)' 


X(z) _ 4 £ 

The partial fraction expansion of Y(z) = -- leads to X(z) = 


2 ' ' 2 — 0.25 

1. If the ROC is \z\ > 0.5, x\n\ is causal and stable, and we obtain 

x[n\ = —4(0.25 ) n u[n] + 4(0.5)"u[n] 


Az 

z- 0.5' 


2. If the ROC is \z\ < 0.25, x[n] is anti-causal and unstable, and we obtain 

x[n ] = 4(0.25) n u[—n — 1] — 4(0.5 ) n u[—n — 1] 

3. If the ROC is 0.25 < \z\ < 0.5, x[n] is two-sided and unstable. This ROC is valid only if .To 25 
describes a causal sequence (ROC \z\ > 0.25), and 735-5 describes an anti-causal sequence (ROC 
|z| < 0.5). With this in mind, we obtain 

x[n] = —4(0.25)"u[n] —4(0.5 ) n u[—n— 1] 

ROC: |z|>0.25 ROC: |z|<0.5 


(b) Find the unique inverse transforms of the following, assuming each system is stable: 


Hl (z — 0.4) ( 2 : + 0.6) H {z-0.5)(z + 2) H (, z-2)(z + 3 ) 


Partial fraction expansion leads to 


Hi M = 


z — 0.5 z + 2 


H 3 (z) = 2 


z — 2 z T 3 


To find the appropriate inverse, the key is to recognize that the ROC must include the unit circle. 
Looking at the pole locations, we see that 


Hi(z) is stable if its ROC is \z\ > 0.6. 

Its inverse is causal, with hi[n] = (0.4)"u[n] — (—0.6)"w[?r]. 

H- 2 {z) is stable if its ROC is 0.5 < \z\ < 2. 

Its inverse is two-sided, with /i2[n] = (0.5)"u[n] + (— 2) n u{—n — 1]. 

H 3 (z) is stable if its ROC is \z\ < 2. 

Its inverse is anti-causal, with h 3 [n] = —(2 ) n u[—n — 1] + (—3)"u [—n — 1]. 
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4.9 The One-Sided z-Transform 

The one-sided 2 -transform is particularly useful in the analysis of causal LTI systems. It is defined by 

OO 

X(z) = E x[k]z k (one-sided 2 -transform) (4.35) 

k =o 

The lower limit of zero in the summation implies that the one-sided 2 -transform of an arbitrary signal x [n] 
and its causal version x[n]u[n] are identical. Most of the properties of the two-sided 2 -transform also apply 
to the one-sided version. 


| REVIEW PANEL 4.17 | 

The Scaling, Times-?!, and Convolution Properties of the One-Sided 2 -Transform 

a n x[n\ <= | zt | =» X(z/a) nx[n] 4= [ zt | => —2 a;[n] * h[n\ 4= | zt | => X(z)H{z) 

However, the shifting property of the two-sided 2 -transform must be modified for use with right-sided (or 
causal) signals that are nonzero for n < 0. We also develop new properties, such as the initial value theorem 
and the final value theorem, that are unique to the one-sided 2 -transform. These properties are summarized 
in Table 4.4. 


Table 4.4 Properties Unique to the One-Sided 2 -Transform 


Property 

Signal 

One-Sided 2 - Transform 

Right shift 

x[n — 1 ] 

z~ x X(z) + ar[—1] 


x[n — 2] 

z~ 2 X(z) + z~ 1 x[— 1] + x\— 2] 


x[n — N] 

z~ N X{z) + 2 -( Ar " 1 )x[-l] + z-( N ~Vx[- 2] + • • • + x[-N] 

Left shift 

x[n + 1 ] 

zX(z) — zx[ 0] 


x[n + 2] 

z 2 X(z) — 2 2 s[ 0 ] — zx[ 1] 


x[n + N] 

z N X{z) - 2 Ar a:[ 0 ] - z N ~ 1 x[ 1]- zx[N - 1] 

Switched 

periodic 

x p [n}u[n] 

X\ (z) 

-- tt (xi[n] is the first period of x p [n}) 

1 — z iV 

Initial value theorem: a:[0] = lim X{z) 

z — >-oo 

Final value theorem: lim x\n\ = lim (2 — l)X(z) 

n — >00 z — >1 


EXAMPLE 4.14 (Properties of the One-Sided 2 - Transform) 

(a) Find the 2 -transform of x[n) = n(4)°- 5n u[n]. 


We rewrite this as x[n] = n(2) n u[n) to get X(z) 


2 2 
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(d) Let (4 ) n u[n\ 4= ZT => X{z). Find the signal corresponding to F(z) = X 2 {z) and G{z) = X{2z). 

By the convolution property, f[n] = (4 ) n u[n] * (4 ) n u[n] = (n + l)(4)”u[n]. 

By the scaling property, G(z) = X(2z) = X{z/ 0.5) corresponds to the signal g[n] = (0.5) n a;[n]. 
Thus, we have g[n] = (2 ) n u[n\. 


4.9.1 The Right-Shift Property of the One-Sided z-Transform 

The one-sided ^-transform of a sequence x[n] and its causal version x[n]u[n] are identical. A right shift of 
x[n] brings samples for n < 0 into the range n > 0, as illustrated in Figure 4.9, and leads to the ^-transforms 

x[n — 1] 4= | zt | => z~ 1 X(z ) + cc[— 1] x[n — 2] <= | zt | =» z~ 2 X(z) + z~ 1 x[~ 1] + x[—2] (4.36) 



x(z) x r—n + z~ l x( Z ) x r—21 + z-'^r-n + z~ 2 x< Z ) 

Figure 4.9 Illustrating the right-shift property of the one-sided z-transform 
These results generalize to 

x[n - N} 4=[zt]=> z~ N X(z) + z“ (JV_1) x[-1] + z~ {N - 2) x[- 2] + • • • + x[-N] (4.37) 

For causal signals (for which x[n] =0, n < 0), this result reduces to x[n — iV] 4= | ZT | =» z~ N X(z). 
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4.9.2 The Left-Shift Property of the One-Sided z-Transform 

A left shift of x[n]zt[n] moves samples for n > 0 into the range n < 0, and these samples no longer contribute 
to the ^-transform of the causal portion, as illustrated in Figure 4.10. 




X(z ) -zjcfOl + zX(z) - z 2 x f01 -zxfll + z 2 X(z) 


Figure 4.10 Illustrating the left-shift property of the one-sided 2 -transform 


This leads to the 2 -transforms 

x[n + 1] zt => zX(z) — zx[ 0] x[n + 2] 4 = zt z 2 X(z ) — 2 2 x[ 0 ] — 2 x[l] (4.38) 

By successively shifting x[n]w[n] to the left, we obtain the general relation 

X[n + N) 4=[zt]=> z N X{z) - z N x[ 0] - z N ~ 1 x{ 1]- zx[N - 1] (4.39) 

The right-shift and left-shift properties of the one-sided 2 -transform form the basis for finding the response 
of causal LTI systems with nonzero initial conditions. 



EXAMPLE 4.15 (Using the Shift Properties) 

(a) Using the right-shift property and superposition, we obtain the 2 -transform of the first difference of 
x[n\ as 

y[n] = x[n ] — x[n — 1] zt => X(z) — z~ 1 X(z ) = (1 — z~ 1 )X(z ) 

(b) Consider the signal x[n] = a n . Its one-sided 2 -transform is identical to that of a n u[n] and equals 
X(z) = 2/(2 — a). If y[n] = x[n — 1], the right-shift property, with N = 1, yields 

Y(z) = z- x X(z) + x[-l] = —'— + a~ l 

z — a 

The additional term a -1 arises because x[n] is not causal. 
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(c) (The Left-Shift Property) 

Consider the shifted step u[n + !]• Its one-sided 2 -transform should be identical to that of u[n\ since 
u[n ] and u[n + 1 ] are identical for n > 0 . 

With u[n] <= \ ZT | =» z/(z — 1) and w[0] = 1, the left-shift property gives 

2 

_ 2* 2, 

u[n + 1] zt => zU{z) — zu[0l =- 7 — 2 = 


z-1 


z-1 


(d) With y[n] = a n u[n] zt => 2/(2 — a) and y[0] = 1, the left-shift property gives 


y[n + 1] = a n+1 u[n + 1] 4= | zt | => 2: 


z — a 


— z = 


az 

z — a 


4.9.3 The Initial Value Theorem and Final Value Theorem 

The initial value theorem and final value theorem apply only to the one-sided 2 -transform and the proper 
part X(z) of a rational 2 -transform. 

| REVIEW PANEL 4^20] 

The Initial Value Theorem and Final Value Theorem for the One-Sided 2 - Transform 
Initial value: a;[0] = lim X(z ) Final value: a;[oo] = lim (2 — 1)X(2) 

»oo z—*l 

Final value theorem is meaningful only if: Poles of (2 — l)X(z) are inside unit circle. 

With X ( 2 ) described by a:[0] + a:[l] 2 -1 + x[2\z~ 2 + • • •, it should be obvious that only a:[0] survives as 
2 —> 00 and the initial value equals a;[0] = lim X(z). 

z—>00 

To find the final value, we evaluate (2 — 1)X(2) at 2 = 1. It yields meaningful results only when the poles 
of (2 — l)X(z) have magnitudes smaller than unity (lie within the unit circle in the 2 -plane). As a result: 

1. x [ 00 ] = 0 if all poles of X(z) lie within the unit circle (since x[n\ will then contain only exponentially 
damped terms). 

2. a:[ 00 ] is constant if there is a single pole at 2 = 1 (since x[n) will then include a step). 

3. a:[ 00 ] is indeterminate if there are complex conjugate poles on the unit circle (since a;[n] will then 
include sinusoids). The final value theorem can yield absurd results if used in this case. 


EXAMPLE 4.16 (Initial and Final Value Theorems) 

Let X ( 2 ) = 7 -—— r — 7. We then find 

(2 — 1) (2 — 0.5) 


The initial value: a;[0] = lim X(z ) = lim — - ~ - 7 - = 1 

2^00 2—>00 (1 — 2 i )(l — 0.52 x ) 

2(2 — 2 ) 

The final value: lim a;[nl = lim (2 — l)X(z) = lim-= —2 

n—*00 1 J 2->l 2->l 2 — 0.5 
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4.9.4 The z-Transform of Switched Periodic Signals 

Consider a causal signal x[n] = a; p [n]u[n] where x p [n\ is periodic with period N. If x\[n] describes the first 
period of x[n\ and has the 2 -transform Xi(z), then the 2 -transform of x[n] can be found as the superposition 
of the 2 -transform of the shifted versions of Xi[?r]: 

X(z) = X 1 (z) + z~ N X 1 (z) + z-^X^z) + • • • = Xx{z)[\ + z~ N + z~ 2N + • • •] (4.40) 


Expressing the geometric series in closed form, we obtain 



EXAMPLE 4.17 ( 2 - Transform of Switched Periodic Signals) 

4 

(a) Find the 2 -transform of a periodic signal whose first period is aq[n] = { 0 , 1, —2}. 
The period of x[n] is N = 3. We then find the 2 -transform of x[n] as 

x i(z) z~ l -2z~ 2 


X{z) = 


1 - 2“ 3 


(b) Find the 2 -transform of x[n\ = sin( 0 . 5 ?r 7 r)u[n]. 

4 

The digital frequency of x[n] is F = So IV = 4. The first period of x[n ] is x\ [n] = {0, 1, 0, —1}. 
The 2 -transform of x[n\ is thus 


X(z) = 


Xi(2) 2- 1 -2- 3 


(c) Find the causal signal corresponding to X(z) = - - 7 . 

1 — 2 3 

Comparing with the 2 -transform for a switched periodic signal, we recognize N = 3 and X\ ( 2 ) = 2+ 2 _1 . 

4 

Thus, the first period of x [n] is {2, 1, 0}. 


(d) Find the causal signal corresponding to X(z) = 


We first rewrite X(z) as 


X{z) = 


Z~\ 1 - Z~ 3 ) = z - 1 -Z ~ 4 

(l + 2-3)(l-2-3) 1-2- 


Comparing with the 2 -transform for a switched periodic signal, we recognize the period as N = 6 , and 
X\ ( 2 ) = 2 _1 — 2 -4 . Thus, the first period of x[n} is {0, 1, 0, 0, —1, 0}. 
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4.10 The z -Transform and System Analysis 

The one-sided 2 -transform serves as a useful tool for analyzing LTI systems described by difference equations 
or transfer functions. The key is of course that the solution methods are much simpler in the transformed 
domain because convolution transforms to a multiplication. Naturally, the time-domain response requires 
an inverse transformation, a penalty exacted by all methods in the transformed domain. 

4.10.1 Systems Described by Difference Equations 

For a system described by a difference equation, the solution is based on transformation of the difference 
equation using the shift property and incorporating the effect of initial conditions (if present), and subsequent 
inverse transformation using partial fractions to obtain the time-domain response. The response may be 
separated into its zero-state component (due only to the input), and zero-input component (due to the 
initial conditions), in the 2 -domain itself. 


| REVIEW PANEL 4.22 | 

Solving Difference Equations Using the 2 - Transform 

Relaxed system: Transform the difference equation, then find Y ( 2 ) and its inverse. 

Not relaxed: Transform using the shift property and initial conditions. Find Y ( 2 ) and its inverse. 


EXAMPLE 4.18 (Solution of Difference Equations) 

(a) Solve the difference equation y[n] — 0.5 y[n — 1] = 2(0.25 ) n u[n] with y[— 1] = —2. 
Transformation using the right-shift property yields 


F(2)-0.5(2-T(2)+y[-l]) = 


2 2 


2-0.25 


Y(z) = 


2(2 + 0.25) 

(2 — 0.25)(z — 0.5) 


We use partial fractions to get 


r(2) 


2 + 0.25 -2 3 

2 “ (2 - 0.25 )(2 - 0.5) - 2 - 0.25 + 2 - 0.5' 

Multiplying through by 2 and taking inverse transforms, we obtain 
—2 2 32 


Y(z) = 


z- 0.25 2 - 0.5 


y[n] = [-2(0.25)" + 3(0.5)"]u[n] 


(b) Let y[n + 1] — 0.5 y[n\ = 2(0.25)" +1 w[n + 1] with y{— 1] = —2. 


We transform the difference equation using the left-shift property. The solution will require y[0]. 
By recursion, with n = —1, we obtain y[0] — 0.5j/[— 1] = 2 or y[0] =2 + 0.5y[—1] =2 — 1 = 1. 


Let x[n ] = (0.25)"u[?r]. Then, by the left-shift property x[n+ 1] 


ZT 


zX(z) — zx[0] (with a;[0] 


1 ), 


(0.25) 


n+1 


u\n - 


ZT 


z 

z- 0.25 


0.25 2 
2 - 0.25 


We now transform the difference equation using the left-shift property: 

0 5 7 

zY(z) - zy[ 0] - 0.5F(2) = —— Y(z) = ^ 

z — 0.25 (z - 


z(z + 0.25) 

- 0.25)(z — 0.5) 
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This is identical to the result of part (a), and thus y[n] = —2(0.25)" + 3(0.5)", as before. 
Comment: By time invariance, this represents the same system as in part (a). 


(c) (Zero-Input and Zero-State Response) Let y[n] — 0.5 y[n — 1] = 2(0.25)"u[n], with y[— 1] = —2. 
Upon transformation using the right-shift property, we obtain 


Y(z)-0.5(z- 1 Y(z) + y[-l}) = 


2z 


(1 - 0.5 z~ l )Y{z) = 


22 


-1 


2-0.25 v ' w 2-0.25 

1. Zero-state response: For the zero-state response, we assume zero initial conditions to obtain 

(1 - 0.52- 1 )U zs (2) = ——— Y zs (z) = 7 -^-- 

v ’ 2-0.25 zsW (z — 0.25)(2 — 0.5) 

Upon partial fraction expansion, we obtain 

Y zs (z) _ 2z 2 4 

z (z - 0.25) (z - 0.5) 2-0.25 + 2 -0.5 

Multiplying through by 2 and inverse transforming the result, we get 

-2 2 42 


Y zs (z) = 


2 - 0.25 2- 0.5 


y zs [n} = —2(0.25 )"it[n] + 4(0.5)"u[n] 


2. Zero-input response: For the zero-input response, we assume zero input (the right-hand side) 
and use the right-shift property to get 

Y zi (z) - 0.5( 2 - 1 U zi ( 2 ) + y[-l]) = 0 Y zi (z) = —?— 

z — U.o 

This is easily inverted to give y z \[n] = — (|)”u[n]. 

3. Total response: We find the total response as 

y[n] = y zs [n ] + y z i[n] = -2(0.25)"u[n] + 3(0.5)"u[n] 


4.10.2 Systems Described by the Transfer Function 

The response Y(z) of a relaxed LTI system equals the product X(z)H(z) of the transformed input and the 
transfer function. It is often much easier to work with the transfer function description of a linear system. 
If we let H(z ) = N(z)/D(z), the zero-state response Y(z) of a relaxed system to an input X(z) may be 
expressed as Y(z) = X(z)H(z ) = X(z)N(z)/D(z). If the system is not relaxed, the initial conditions result 
in an additional contribution, the zero-input response 1 ^( 2 ), which may be written as Y z i(z) = N z i(z)/D(z). 
To evaluate Y z {(z), we first set up the system difference equation, and then use the shift property to transform 
it in the presence of initial conditions. 


REVIEW PANEL 4.23 
System Analysis Using the Transfer Function 

Zero-state response: Evaluate Y(z) = X(z)H(z) and take inverse transform. 

Zero-input response: Find difference equation. Transform this using the shift property and initial 
conditions. Find the response in the 2 -domain and take inverse transform. 
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EXAMPLE 4.19 (System Response from the Transfer Function) 


(a) (A Relaxed System) Let H(z) = 


3 2 


2-0.4 

x[n] = (0.4) n u[n], we first transform the input to X(z) = 


To find the zero-state response of this system to 

z 


Then, 


Y(z) = H(z)X(z) = 


3z 2 

(2 — 0.4 ) 2 


2-0.4 
y[n] = 3(n+ l)(0.4) n w[n] 


(b) (Step Response) Let H(z) 


4 2 

2-0.5' 


To find its step response, we let x[n] = u[n}. Then X(z) 


z 

2 - 1 ’ 


and the output equals 


Using partial fraction expansion of Y ( 2 ) / 2 , we obtain 


42 2 

(2 — 1 )( 2 — 0.5) 


Y(z) 4 2 8 4 

2 “ ( 2 - 1) ( 2 -0.5) ~ 2-1 ~~ 2 - 0.5 


Thus, 

F( 2 ) = ——- y[n] = 8 u[n] - 4(0.5) n u[n] 

z 1 z u.o 

The first term in y[n\ is the steady-state response, which can be found much more easily as described 
shortly. 


(c) (A Second-Order System) Let H(z) = 




. Let the input be x[n] = 4u[n] and the initial 


conditions be y[— 1 ] = 0 , y[— 2 ] = 12 . 

1. Zero-state and zero-input response: The zero-state response is found directly from H{z) as 

42^ 42^ 

Y zs (z) X(z)H(z ) ( 2 2 - \z- g)(2-i) ( 2 - \){z+ |)( 2 - 1) 

Partial fractions of Y zs (z)/z and inverse transformation give 


. . -2.42 0.42 62 

Yzs(z) = -- r + — T + 


2-f 2+§ 2-1 


2/zsM = -2.4(l) n u[?r] + 0.4(-l)"u[n] + 6u[n] 


To find the zero-input response, we first set up the difference equation. We start with 

H ( 2 ) = S4 = -j—£-T’ OT (* 2 ~h~ \)Y{*) = z 2x (z)- This gives 

X(z) z 2 -z Z ~z 


i l -\ z 1 - \ z 2 ) y (z) = X(z) y[n] - \y[n - 1] - \y[n - 2] = x[n] 
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We now set the right-hand side to zero (for zero input) and transform this equation, using the 
right-shift property, to obtain the zero-input response from 

- H z ~ lY ^( z ) + 2 /b 1 ]) - U z ~ 2y *( z ) + z ~ l y[~ l \ + v[- 2 1) = 0 

With y[— 1] = 0 and y[— 2] = 12, this simplifies to 

2z 2 2z 2 


Y *(z) = 


z 2 ~l z ~l ( z ~k)( z +k) 


6 ' 3 ' 

Partial fraction expansion of Y z i(z)/z and inverse transformation lead to 


1.2z O. 82 ; 

Yi{z) = z —r + ~T 


z 2 z Y 3 


y zi [n] = 1.2 (\) n u[n\ + 0 . 8 (-|) n u[n] 


Finally, we find the total response as 


y[n] = y zs [n] + y zi [n\ = -1.2 (\) n u[n\ + l.2{-\) n u[n] + 6 u[n] 

2. Natural and forced response: By inspection, the natural and forced components of y[n] are 
VN[n\ = -1.2 {\) n u[n} + 1.2 {-\) n u[n\ y F [n] = 6 u[n\ 

Comment: Alternatively, we could transform the system difference equation to obtain 

4 7 

Y ( z ) - U z Y ( z ) + 2/[-i]) - U z Y W + z y[~ 1 ] + y [- 2 ]) = 


z-l 


This simplifies to 


Y (z) = 


z 2 (6z-2) 


- 1.2 z 1.2 2 


6z 


(z-l)(z 2 -\z-\) 


z +l z ~ 1 


The steady-state response corresponds to terms of the form z/(z — 1) (step functions). For this 
example, Yp(z) = 7 ^- and y F [n\ = 6 u[n\. 

Since the poles of (z — 1 )Y(z) lie within the unit circle, can also be found by the final value 
theorem: 

z 2 (6z-2) 


VF[n\ = lim(z — l)Y(z) = lim 


1 ' ' ' ' 1 z 2 -\z-\ 


= 6 


4.10.3 Forced and Steady-State Response from the TT’ansfer Function 

In the time domain, the forced response is found by assuming that it has the same form as the input 
and then satisfying the difference equation describing the LTI system. If the LTI system is described 
by its transfer function H(z), the forced response may also be found by evaluating H(z) at the complex 
frequency z 0 of the input. For example, the input x[n] = Ka n cos(?rfl + </)) has a complex frequency given 
by Zq = aei n . Once H(zq) = H 0 e^° is evaluated as a complex quantity, the forced response equals 
yF[n\ = KHoa n cos(nf! + <j>+ <t>o). For multiple inputs, we simply add the forced response due to each input. 
For dc and sinusoidal inputs (with a = 1), the forced response is also called the steady-state response. 


©Ashok Ambardar, September 1, 2003 





162 


Chapter 4 z-Transform Analysis 


EXAMPLE 4.20 (Finding the Forced Response) 

z 

(a) Find the steady-state response of the a filter described by H(z) = -— to the input x[n\ = 

cos(0.6mr). 

The complex input frequency is Zq = e j0 67r . We evaluate H{z ) at z = Zq to give 


F(z) 


Z— e j0.6-K 


e i0.67T 

e i0.67T _ 0.4 


0.843e _i18 - 7 


o 


The steady-state response is thus y F [n] = 0.843 cos(0.6ri7r — 18.7°). 


(b) Find the forced response of the system H{z) = 


to the input x[n] = 5(0.6)”. 


z- 0.4 

The complex input frequency is zo = 0.6. We evaluate H(z) at z = 0.6 to give 


H{z) 


0.6 


12 = 0.6 0.6 — 0.4 

The forced response is thus j/fN = (3)(5)(0.6)" = 15(0.6) n . 


= 3 


(c) Find the forced response of the system H(z) = —--. The input contains two components and 

is given by x[n] = x\ [n] + Xi [n] = (0.6) ra + 2(0.4)” cosfo.5n7r — 100°). 

The forced response will be the sum of the forced component yi[n\ due to X\[n] and j /2 [n] due to a; 2 [n]. 
The complex input frequency of x\ [n] is Zq = 0.6. We evaluate H(z) at z = 0.6 to give 


H(z) 


2 = 0.6 


3(0.36) 

0.36-0.6 + 1 


1.4211 


So, 2 /i[n] = 1.4211(0.6)”. 

The complex input frequency of x 2 [n] is z 0 = 0.4e- 7U5 ”' = j0.4. We evaluate H(z) at z = j0.4 to give 


H(z) 


3(—0.16) 


i 2 =j0.4 —0.16 —j'0.4 + 1 

So, 2 / 2 [n] = (0.5159)(2)(0.4)” cos(0.5n7r — 100° + 154.54°) 
Finally, by superposition, the complete forced response is 


: 0.5159e^ 154 - 54 ° 

1.0318(0.4)” cos(0.5?i7T + 54.54°). 


yF [n\ = yi[n\ + y 2 [n\ = 1.4211(0.6)" + 1.0318(0.4)” cos(0.5n7r + 54.54°) 
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CHAPTER 4 PROBLEMS 


4.1 (The 2 -Transform of Sequences) Use the defining relation to find the 2 -transform and its region 
of convergence for the following: 

(a) x[n] = {1, 2, 3, 2, 1} (b) y[n] = {-1, 2, 0, -2, 1} 

(c) f[n] = {1, 1, 1, 1} (d) g[n] = {1, 1, -1, - 1} 

4.2 ( 2 - Transforms) Find the ^transforms and specify the ROC for the following: 

(a) x[n] = (2)” +2 u[n] (b) y[n] = n(2) 2 ™u[n] 

(c) f[n] = (2)™ +2 w[n — 1] (d) g[n] = n(2) n+2 ii[n — 1] 

(e) p[n] = (n + 1)(2 ) n u[n] (f) q[n] = (n — l)(2)” +2 w[n] 

[Hints and Suggestions: For (a), (2)™ +2 = (2) 2 (2)™ = 4(2)™. For (b), (2) 2 ™ = ((2 2 )™ = (4)™. For 
(e), use superposition with (n + 1)(2)™ = n(2)” + (2)™.] 

4.3 (The z- Transform of Sequences) Find the 2 -transform and its ROC for the following: 

(a) x[?r] = u[n + 2] — u[n — 2] 

(b) y[n] = (0.5)™(«[n + 2] — u[n — 2]) 

(c) f[n] = (0.5)1™! (u[n + 2] — u[n — 2]) 

[Hints and Suggestions: First write each signal as a sequence of sample values.] 

4.4 ( 2 - Transforms) Find the ^transforms and specify the ROC for the following: 

(a) x[n] = (0.5) 2 ™u[?i] (b) x[n] = ?r(0.5) 2 ™u[n] (c) (0.5)“™u[?r] 

(d) (0.5)™u[—n] (e) (0.5)™u[—n — 1] (f) (0.5)-”u[-n - 1] 

[Hints and Suggestions: For (a)-(b), (0.5) 2 ” = (0.5 2 )™ = (0.25)™. For (c) and (f), (0.5)"™ = (2)™. 
For (d), fold the results of (c).] 

4.5 ( 2 - Transforms) Find the 2 -transforms and specify the ROC for the following: 

(a) x[n} = cos{ n f- — f )u[n] (b) y[n] = (0.5)™cos( I j : )u[?r] 

(c) f[n] = (0.5)™cos( I f - f )u[n] (d) g[n] = (g)™(u[n] - u[n - 4]) 

(e) p[n ] = n(0.5)™ cos( I y : )u[?r] (f) q[n ] = [(0.5)™ — (—0.5)™]nw[n] 

[Hints and Suggestions: For (a), cos(0.25n7r — 0.257r) = 0.7071 cos(0.25n7r) + 0.7071 sin(0.25n7r). 

For (b), start with the transform of cos(0.25n7r) and use properties. For (c), start with the result for 
(a) and use the times-a™ property. For (e) start with the result for (b) and use the times-?r property.] 

4.6 (Two-Sided 2 -Transform) Find the 2 -transform X(z) and its ROC for the following: 

(a) x[n} = u[—n — 1] (b) y[n] = (0.5 ) _ ™'«[—n — 1] 

(c) f[n\ = (0.5)!™! (d) g[ n ] = u [_ n _ 1 ] -|_ (i)"u[n] 

(e) p[n} = (0.5) - ™u [—n — 1] + (|)”u[n] (f) q[n\ = (0.5)!™! _|_ (_o.5)l"l 

[Hints and Suggestions: For (a), start with the transform of u[n — 1] and use the folding property. 

For (c), note that (0.5)!™! = (0.5)™it[?r] + (0.5) _ ™u[—n] — <5[n]. For the ROC, note that (c)-(f) are 
two-sided signals.] 
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4.7 (The ROC) The transfer function of a system is H(z). What can you say about the ROC of H{z) 
for the following cases? 

(a) h[n] is a causal signal. 

(b) The system is stable. 

(c) The system is stable, and h[n] is a causal signal. 

4.8 (Poles, Zeros, and the ROC) The transfer function of a system is H(z). What can you say about 
the poles and zeros of H(z) for the following cases? 

(a) The system is stable. 

(b) The system is causal and stable. 

(c) The system is an FIR filter with real coefficients. 

(d) The system is a linear-phase FIR filter with real coefficients. 

(e) The system is a causal, linear-phase FIR filter with real coefficients. 

4.9 (z- Transforms and ROC) Consider the signal x[n] = a n u[ r n\ + (3 n u[—n — 1]. Find its 2 -transform 
X(z). Will X(z) represent a valid transform for the following cases? 

(a) a > /3 (b) a < (3 (c) a = P 

4.10 (z- Transforms) Find the ^-transforms (if they exist) and specify their ROC. 

(a) x[n] = (2 )~ n u[n\ +2 n u[—n] (b) y[n] = (0.25)"u[n] + 3"tt[—n] 

(c) f[n] = (0.5)"ii[n] + 2 n u[—n — 1] (d) g[n] = (2 ) n u[n] + (0.5)™w[—n — 1] 

(e) p[n] = cos(0.5n7r)'it[n,] (f) q[n] = cos(0.5n7r + 0.257r)w[n] 

(g) s[n] = e^ nir u[n\ (h) t[n ] = e? ra7r / 2 u[n] 

(i) v[n] = e- ?mr / 4 u[n] (j) w[n] = (\fj) n u[n] + {^/j)~ n u[n] 

[Hints and Suggestions: Parts (a)~(c) are two-sided signals. Part (d) does not have a valid transform. 
For (f), cos(0.5n7r + 0.25n7r) = 0.7071 [cos(0.5?r7r) — sin(0.5n7r)]. For part (j), use j = e? 71 '/ 2 and Euler’s 
relation to express rc[?r] as a sinusoid.] 

4.11 (z- Transforms and ROC) The causal signal x[n] = a n u[n] has the transform X{z) whose ROC is 
\z\ > a. Find the ROC of the ^-transform of the following: 

(a) y[n] = x[n — 5] 

(b) p[n\ = x[n + 5] 

(c) g[n\ = x[—n] 

(d) h[n] = (— 1 ) n x[n] 

(e) p[n\ = a n x[n] 

4.12 (z- Transforms and ROC) The anti-causal signal x[n\ = — a n u[—n — 1] has the transform X(z) 
whose ROC is \z\ < a. Find the ROC of the 2 -transform of the following: 

(a) y[n] = x[n — 5] 

(b) p[n\ = x[n + 5] 

(c) g[n] = x[-n\ 

(d) h[n] = (— l) n x[n] 

(e) r[n\ = a n x[n] 

4.13 ( 2 - Transforms) Find the 2 -transform X(z) of x[n} = al" and specify the region of convergence of 
X(z). Consider the cases |cr| < 1 and |a| > 1 separately. 
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4.14 (Properties) Let x[n\ = nu[n}. Find X(z), using the following: 

(a) The defining relation for the 2 -transform 

(b) The times-?! property 

(c) The convolution result u[n] * w[n] = (n + 1 )u[n + 1] and the shifting property 

(d) The convolution result u[n] * w[n] = (n + 1 )u[n] and superposition 


4.15 (Properties) The 2 -transform of x [n] is X{z) = 


Az 


(z + 0.5) 2 ’ 1 

following using properties and specify the region of convergence. 


zl > 0.5. 


Find the 2 -transform of the 


(a) y[n\ = x[n — 2] (b) d[n} 

(d) g[n] = (2 ) n nx[n] (e) h[n] 

(g) q[n] = x\—n] (h) ?’[??] 


(2 ) n x[n] 
n 2 x[n} 

x[n] — x[n — 1] 


(c) f[n] = nx[n] 

(f) p[n] = [n — 2 }x[n) 
(i) s[?r] = x[n] -k x[n} 


[Hints and Suggestions: For (d)-(f), use the results of (c).] 


4.16 (Properties) The ^-transform of x[n] = (2 ) n u[n] is X(z). Use properties to find the time signal 
corresponding to the following: 


(a) Y(z) = X(2 z) 

(d) H(z) = 

(g) Q{z) = z~ 2 X(2z) 


(b) F(z) = X(l/z) 
(e) D(z) = 

(h) R(z) = X 2 (z) 


(c) G(z) = zX'(z) 
(f) P(z) = z^Xiz) 

(i) S(z) = X(-z) 


[Hints and Suggestions: Parts(d)-(e) require the summation property.] 


4.17 (Properties) The ^-transform of a signal x [n] is X(z) 

and its ROC for the following. 

(a) y[n] = (-l) n a:[n] (b) f[n] = x[2n] 

(c) g[n] = (j) n x[n] (d) h[n ] = x[n + 1] + x[n — 1] 


4z 

(z + 0.5) 2 ’ 


\z\ > 0.5. 


Find the z-transform 


[Hints and Suggestions: For part (b), find x[n\ first and use it to get f[n] = x[2n\ and F(z). For 
the rest, use properties.] 


4.18 (Properties) The ^-transform of the signal x[n] = (2 ) n u[n\ is X{z). Use properties to find the time 
signal corresponding to the following. 


(a) F(z) = X(-z) (b) G(z) = X(l/z) (c) H{z) = zX'(-z) 

% 

4.19 (Properties) The ^-transform of a causal signal x[n] is X{z) = — 

(a) Let x e [n\ be the even part of x[n}. Without computing x [n] or x e [n\, find X e (z ) and its ROC. 

(b) Confirm your answer by first computing x e [n] from x [n] and then finding its ^-transform. 

(c) Can you find X e (z ) if x[n ] represents an anti-causal signal? Explain. 


4.20 (Properties) Find the ^-transform of x[n] = rect(n/27V) = u[n + iV] — u[n — N — 1], Use this result 
to evaluate the ^-transform of y[n] = tri (n/M) where M = 2N + 1. 

[Hints and Suggestions: Recall that rect(n/2iV) * rect(n/2N) = Mtri(n/M) where M = 2 N + 1 
and use the convolution property of 2 -transforms.] 
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4.21 (Poles and Zeros) Make a rough sketch of the pole and zero locations of the ^-transform of each of 
the signals shown in Figure P4.21. 



Figure P4.21 Figure for Problem 4.21 


[Hints and Suggestions: Signal 1 has only three samples. Signals 2 and 3 appear to be exponentials. 
Signal 4 is a ramp. Signal 5 appears to be a sinusoid.] 


4.22 (Pole-Zero Patterns and Symmetry) Plot the pole-zero patterns for each X(z). Which of these 
correspond to symmetric sequences? 


(a) X(z) = Z2+Z 1 (b) X(z) 

z 

z^ — z ^ -I- z — 1 

(c)X{z) = -— f - (d) X(z) 

Z z 


z 4 + 2 z 3 + 3z 2 + 2z + 1 
z 2 

(z 2 ~l)(z 2 + l) 

y2 


[Hints and Suggestions: If a sequence is symmetric about its midpoint, the zeros exhibit conjugate 
reciprocal symmetry. Also, X(z) = ±X(1 /z) for symmetry about the origin.] 


4.23 (Realization) Sketch the direct form I, direct form II, and transposed realization for each filter. 

(a) y[n] - \y[n - 1] - \y[n - 2] = 3 x[n\ (b) H(z) = ^ 

(c) y[n] - 3 y[n - 1] + 2 y[n - 2] = 2 x[n - 2] (d) H(z) = ' 2 “ - 

[Hints and Suggestions: For each part, start with the generic second-order realization and delete 
any signal paths corresponding to missing coefficients.] 


4.24 (Realization) Find the transfer function and difference equation for each system realization shown 
in Figure P4.24. 


System 1 



Figure P4.24 Filter realizations for Problem 4.24 

[Hints and Suggestions: Compare with the generic first-order and second-order realizations to get 
the difference equations and transfer functions.] 



4.25 (Realization) Find the transfer function and difference equation for each digital filter realization 
shown in Figure P4.25. 
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Figure P4.25 Filter realizations for Problem 4.25 


[Hints and Suggestions: For (a), compare with a generic third-order direct form II realization. For 

(b), compare with a generic second-order transposed realization.] 


4.26 (Inverse Systems) Find the transfer function of the inverse systems for each of the following. Which 
inverse systems are causal? Which inverse systems are stable? 

/ \ ~r / \ Z 2 + 0.1 \ t~ r / \ Z + 2 


(a) H{z) = 


(b) H{z) = 


(c) y[n\ — 0.5 y[n — 1] = x[n] + 2 x[n — 1] (d) h[n] = n{2) n u[n] 

[Hints and Suggestions: For parts (c) and (d), set up H{z) and find Hj(z) = 1/H(z).\ 


4.27 (Causality and Stability) How can you identify whether a system is a causal and/or stable system 
from the following information? 

(a) Its impulse response h[n] 

(b) Its transfer function H ( 2 ) and its region of convergence 

(c) Its system difference equation 

(d) Its pole-zero plot 


4.28 (Switched Periodic Signals) Find the 2 -transform of each switched periodic signal. 

4 

(a) x[n] = {2, 1, 3, 0,...}, N = 4 (b) y[n] = cos(mr/2)u[n] 

(c) f[n] = {0, 1, 1, 0, 0,...}, N = 5 (d) g[n] = cos(0.5?17t + 0.257r)u[?r] 

[Hints and Suggestions: For parts (b) and (d), the period is N = 4. Write out the sequence for the 
first period to find the transform of the periodic signal.] 

4.29 (Inverse Transforms of Polynomials) Find the inverse 2 -transform of the following: 

(a) X(z) =2-z~ 1 + 3 2 " 3 (b) Y(z) = (2 + 2 " 1 ) 3 

(c) F(z) = (2 - 2 " 1 ) 2 (d) G(z ) = (2 - 2 - 1 ) 2 (2 + 2 ) 

[Hints and Suggestions: For parts (b)-(d), expand the transform first.] 


4.30 (Inverse Transforms by Long Division) Assuming right-sided signals, determine the ROC of the 
following 2 -transforms and compute the inverse transform by long division up to n — 3. 


(a) X(z) 


(z+ l) 2 

2 2 + 1 


(b) Y(z) 


2 + 1 
2 2 + 2 


(c) F ( 2) = ^5 (d)G(2) 


1 — 2 —2 
2 + 2 —1 


[Hints and Suggestions: Before dividing, set up the numerator and denominator as polynomials in 
descending powers of 2 and obtain the quotient in powers of 2 -1 .] 
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4.31 (Inverse Transforms by Partial Fractions) Assuming right-sided signals, determine the ROC of 
the following ^-transforms and compute the inverse transform using partial fractions. 

<“> = (z+lKz + 2 ) < b > - (, - 2 K, + 2 ) 

3 z 2 3 z 3 

(c) F(z) - _ ! 5 ^ 0 . 5 )(^ — 0.25) ^ ~ (z 2 - 1.5z + 0.5) (z - 0.25) 

(e) P(z) - ^2_ 15z + 0 .5)(^_o.25) ^ ~ (z + l) 2 (z + 3) 

[Hints and Suggestions: For part (e), P(z) is not proper. Use long division to get P(z) = 3z + P\{z) 
and use partial fractions for P\(z). Only part (f) has repeated roots.] 

4.32 (Inverse Transforms by Partial Fractions) Assuming right-sided signals, determine the ROC of 
the following ^-transforms and compute the inverse transform using partial fractions. 


(a) X{z) = 
(c) F{z) = 


{z 2 + z + 0.25)(z + 1) 
1 

{z 2 + z + t).2b){z + 1 ) 


(b) Y(z) = 
(d) G(z) = 


(z 2 + z + 0.25) (z + 0.5) 

z 

(z 2 + z + 0.5)(z + l) 


(e) P(z) ( 2 2_, + 0 . 5 )(._i) ( f ) QW ( 0 2 + z + o . 5 )( 2 + i) 

= (z 2 - 0.25) 2 T(Z) = (z 2 - 0.25) 2 

z z 2 

(l ^ = (z 2 + 0.25) 2 = (z 2 + 0.25) 2 

[Hints and Suggestions: Parts (a)-(c) and (g)-(h) have real repeated roots. Parts (d)-(f) have 
complex roots. Parts (i)-(j) have complex repeated roots.] 


(g) S(z) = 
(i) v(z) = 


( z 2 ~z + 0.5)(z~l ) 
2z 

(z 2 - 0.25) 2 


(z 2 + 0.25) 2 


(d) G(z) = — 


4.33 (Inverse Transforms by Long Division) Assuming left-sided signals, determine the ROC of the 
following ^-transforms and compute the inverse transform by long division for n = — 1 ,— 2 ,—3. 

W^) = ^T2 < b >’"M = (ITIF 

(c) F(z) = 3 (d) G(z) = d±i 

z 6 + z —l z 2 + 1 

[Hints and Suggestions: Before dividing, set up the numerator and denominator as polynomials in 
ascending powers of 3 and obtain the quotient in ascending powers of z.] 

z 2 | bz 

4.34 (The ROC and Inverse Transforms) Let X(z) = —-. Which of the following describe a 

z 2 z 3 

valid ROC for X(z)7 For each valid ROC, find x[n], using partial fractions. 

(a) \z\ < 1 (b) \z\ >3 (c) 1 < |z| < 3 (d) \z\ < 1 and \z\ > 3 

4.35 (Inverse Transforms) For each A(z), find the signal x[n ] for each valid ROC. 

z 3 Z 2 

(a) X(z) = (2 + 0 4)(2 _ 0 6) ( b ) X ( z ) = 2 2 _ L5x + o .5 

4.36 (Inverse Transforms) Consider the stable system described by y[n] + ay[n — 1] = x[n] + x[n — 1]. 
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(a) Find its causal impulse response h[n ] and specify the range of a and the ROC of H(z). 

(b) Find its anti-causal impulse response h[n] and specify the range of a and the ROC of H(z). 


4.37 (Inverse Transforms) Each X(z) below represents the 2 -transform of a switched periodic signal 
x p [n ]u [n]. Find one period X\ [n] of each signal. You may verify your results using inverse transformation 
by long division. 

(a) X(z) = (b) X(z) = 1 


(c) X(z) = 


l-z~ 3 
1 + 2 z- 1 
1-z 


-4 


(d) X(z) = 


1 + Z~ 3 

3 + 2 z- 1 
1 + z 


-4 


X (z ) 

[Hints and Suggestions: Set up X(z) in the form --i n order to identify the period N and 

the sequence representing the first period aqfn]. For part(b), for example, multiply the numerator and 
denominator by (1 — 2 -3 ).] 


4.38 (Inverse Transforms) Let H(z) = z 2 (z — 0.5)(2z + 4)(1 — z 2 ). 

(a) Find its inverse transform h[n]. 

(b) Does h[n] show symmetry about the origin? 

(c) Does h[n] describe a linear phase sequence? 


[Hints and Suggestions: Expand H(z) first.] 

% 

4.39 (Inverse Transforms) Let H(z) = - -—--. 

v ' w (2 - 0.5)(z + 2) 

(a) Find its impulse response h[n] if it is known that this represents a stable system. Is this system 
causal? 

(b) Find its impulse response h[n] if it is known that this represents a causal system. Is this system 
stable? 


4.40 (Inverse Transforms) Let H(z) = 


(z — 0.5) (z + 2) ’ 
response h[n], and investigate its stability for the following: 


Establish the ROC of H(z ), find its impulse 


(a) A causal h[n] (b) An anti-causal h[n] (c) A two-sided h[n\ 

4.41 (Convolution) Simplify each convolution using the 2 -transform. You may verify your results by using 
time-domain convolution. 

(a) y[n] = {- 1, 2 , 0 , 3} * {2, 0 , 3} (b) y[n) = {-1,2,0, -2,1} * {-1, 2 , 0 , -2,1} 

(c) y[n] = (2 ) n u[n\ * (2 ) n u[n] (d) y[n] = (2 ) n u[n] * (3 ) n u[n] 

4.42 (Periodic Signal Generators) Find the transfer function H(z) of a filter whose impulse response 

4 

is a periodic sequence with first period x[n] = {l, 2, 3, 4, 6, 7, 8}. Find the difference equation and 
sketch a realization for this filter. 


4.43 (Periodic Signal Generators) It is required to design a filter whose impulse response is a pure 
cosine at a frequency of Fo = 0.25 and unit amplitude. 

(a) What is the impulse response of this filter? 

(b) Find the transfer function H(z) and the difference equation of this filter. 
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(c) Sketch a realization for this filter. 

(d) Find the step response of this filter. 
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4.44 (Initial Value and Final Value Theorems) Assuming right-sided signals, find the initial and final 
signal values without using inverse transforms. 


(a) X(z) 
(c) F(z) 
(e) P{z) 


2 



z 2 + z-l 
z + 0.25 
z 2 + 0.25 


(b) Y(z) 
(d) G(z) 
(f) Q(z) 


2z 2 

z 2 + z + 0.25 
2z 2 + 0.25 
(z- l )(2 + 0.25) 
2z + l 

2 2 - 0.52 - 0.5 


[Hints and Suggestions: To find the initial value, set up each transform as the ratio of polynomials 
in 2 —1 . The final value is nonzero only if there is a single pole at 2 = 1 and all other poles are inside 
the unit circle. For part (c), the final value theorem does not hold.] 


4.45 (System Representation) Find the transfer function and difference equation for the following causal 
systems. Investigate their stability, using each system representation. 

(a) h[n\ = (2) n it[ n ] (b) h[n] = [1 — (g)"]u[n] 

(c) h[n] = n(|)"u[n] (d) h[n ] = 0.5<5[n] 

(e) h[n] = <5[n] — (—|)"u[n] (f) h[n] = [(2)” — (3)"]u[n] 

[Hints and Suggestions: To find the difference equation, set up H(z) as a ratio of polynomials in 

2 -1 , equate with Y(z)/X(z), cross multiply and find the inverse transform.] 


4.46 (System Representation) Find the difference equation of the following causal systems. Investigate 


the stability of each system. 





( a ) 

y[n\ 

+ 3 y[n — 1] + 2 y[n - 

-2] = 

2x[n] 

+ 3x [n - 

-1] 

(b) 

y[n] 

+ 4 y[n — 1] + 4 y[n - 

- 2] = 

2x [n] 

+ 3x [n - 

-1] 

( c ) 

y[n\ 

= 0.2cr[n] 





(d) 

y[n] 

= x[n] + x[n — 1] + 

x[n — 

2] 




4.47 (System Representation) Set up the system difference equations of the following causal systems. 
Investigate the stability of each system. 


(a) H{z) = -A- (b) H(z) 

Z ~r Z 


1 + 2 2 + 2 2 
(1 + 2 2 )( 4 + z 2 ) 
2z _ 1 

1+2 2+2 


[Hints and Suggestions: Set up H(z) as a ratio of polynomials in 2 1 , equate with Y(z)/X(z), cross 
multiply and find the inverse transform.] 


4.48 (Zero-State Response) Find the zero-state response of the following systems, using the 2 -transform. 

(a) y[n] — 0.5 y[n — 1] = 2 u[n] (b) y[n ] — 0.4y[n — 1] = (0.5) n 'u[n] 

(c) y[n] — 0Ay[n — 1] = (0.4) n u[n] (d) y[n ] — 0.5y[?r — 1] = cos(n7r/2) 

[Hints and Suggestions: Use the 2 -transform to get Y(z) assuming zero initial conditions. Then 
find the inverse transform by partial fractions.] 
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4.49 (System Response) Consider the system y[n\ — 0.5 y[n — 1] = x[n\. Find its zero-state response to 
the following inputs, using the ^-transform. 

(a) x\n\ = u[n] (b) x[n] = (0.5)”u[n] (c) x[n ] = cos(n7r /2)u[n\ 

(d) x[n ] = (—1 ) n u[n) (e) x[n] = (j) n u[n\ (f) x[n] = ( y/j) n u[n} + {\Jf)~ n u[n ] 

[Hints and Suggestions: In part (e), y[n] will be complex because the input is complex. In part (f), 
using j = e 17T /’ 2 and Euler’s relation, x[n] simplifies to a sinusoid. Therefore, the forced response 
is easy to find. Then, y[n] = K{ 0.5)™ + yp[n} with y[— 1] = 0.] 

4.50 (Zero-State Response) Find the zero-state response of the following systems, using the ^-transform. 

(a) y[n] — 1.1 y[n — 1] + 0.3y[?r — 2] = 2 u[n] (b) y[n] — 0.9 y[n — 1] + 0.2 y[n — 2] = (0.5)” 

(c) y[n] + 0.7 y[n — 1] + 0.1y[n — 2] = (0.5)” (d) y[n] — 0.25y[n — 2] = cos(n7r/2) 

4.51 (System Response) Let y[n\ — 0.5 y[n — 1] = x[n], with y[— 1] = —1. Find the response y[n\ of this 
system for the following inputs, using the ^-transform. 

(a) x[n ] = 2 u[n] (b) x[n] = (0.25)”u[n] (c) x[n] = n(0.25) n u[n} 

(d) x[n} = (0.5) n u[n] (e) x[n] = n(0.5)™ (f) x[n] = (0.5)” cos(0.5n7r) 

4.52 (System Response) Find the response y[n] of the following systems, using the ^-transform. 

(a) y[n] + 0.1y[?r — 1] — 0.3 y[n — 2] = 2 u[n] j/[— 1] = 0 y[— 2] = 0 

(b) y[n\ - 0.9y[n - 1] + 0.2y[n — 2] = (0.5)” y[- 1] = 1 y[- 2] = —4 

(c) y[n\ + 0.7y[n - 1] + 0.1y[n - 2] = (0.5)” j/[-l] = 0 y[- 2] = 3 

(d) y[n] - 0.25y[n - 2] = (0.4)” y[-l] = 0 y[- 2] = 3 

(e) y[n] - 0.25 y[n - 2] = (0.5)” y[-l] = 0 y[- 2] = 0 

4.53 (System Response) For each system, evaluate the response y[n\, using the ^-transform. 

(a) y[n] — 0Ay[n — 1] = x[n] x[n] = (0.5)”u[n] j/[—1] = 0 

(b) y[n] — 0Ay[n — 1] = 2 x[n\ + x[n — 1] x[n\ = (0.5)”u[nj ?/[—1] = 0 

(c) y[n} — 0Ay[n — 1] = 2 x[n] + x[n — 1] x[n] = (0.5)”u[?rj y[— 1] = 5 

(d) y[n] + 0.5y[n — 1] = x[n] — x[n — 1] x[n] = (0.5)”u[nj y[— 1] = 2 

(e) y[n] + 0.5y[n — 1] = x[n] — x[n — 1] x[n] = (—0.5)”u[n] j/[—1] = 0 

4.54 (System Response) Find the response y[n] of the following systems, using the ^-transform. 

(a) y[n] — QAy[n — 1] = 2(0.5)" _1 it[« — 1] ?/[—1] = 2 

(b) y[n} - 0Ay[n - 1] = (0.4)”u[n] + 2(0.5)"- 1 u[n - 1] y[- 1] = 2.5 

(c) y[n] — 0Ay[n — 1] = n(0.5)”u[n] + 2(0.5)” _1 u[n — 1] y[— 1] = 2.5 


4.55 (System Response) The transfer function of a system is H(z) = ^ ^ Find its response 

y[n] for the following inputs. 

(a) x[n ] = <5[?x] (b) x[n ] = 2 5[n] + <5[?z + 1] (c) x[n] = u[n } 

(d) x[n ] = (2 ) n u[n) (e) x[n ] = nu[n] (f) x[n} = cos( ! y : )u[n] 

4.56 (System Analysis) Find the impulse response h[n] and the step response s[n] of the causal digital 
filters described by 

(a) H(z) = 4 ~ (b) y[n] + 0.5 y[n - 1] = 6a;[n] 

2 — U.o 

[Hints and Suggestions: Note that y[— 1] = 0. Choose a;[n] = u[n) to compute the step response.] 
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4.57 (System Analysis) Find the zero-state response, zero-input response, and total response for each of 
the following systems, using the ^-transform. 


( a ) VH ~ \y[n~ !] = 

(b) y[n] + 1.5 y[n — 1] + 0.5 y[n — 2] = (—0.5) n u[n] 

(c) y[n ] + y[n — 1] + 0.25 y[n — 2] = 4(0.5) n u[n] 

(d) y[n] — y[n — 1] + 0.5 y[n — 2] = (0.5)"u[n] 


y{- 1] = 8 

y[- 1] = 2 2 / 1 — 2 ] = -4 

2 /[— 1 ] = 6 2 /[— 2 ] = -12 
y[-l] = -l 2/[—2] = —2 


4.58 (Steady-State Response) The transfer function of a system is H(z) 
state response for the following inputs. 

(a) x[n\ = 4 u[n\ (b) x[n\ = 4cos( I !f + \)u[n\ 

(c) x[n] = cos(™) + sin(^) (d) x[n] = dcos^) + 4sin(^) 


2 z(z — 1) 
z 2 + 0.25' 


Find its steady- 


[Hints and Suggestions: For parts (c)-(d), add the forced response due to each component.] 


Z — (X 

4.59 (Steady-State Response) The filter H(z) = A - is designed to have a steady-state response 

z — 0.5a 

of unity if the input is u[n] and a steady-state response of zero if the input is cos(?r7r). What are the 
values of A and a? 

z — ex 

4.60 (Steady-State Response) The filter H(z) = A - is designed to have a steady-state response 

of zero if the input is u[n) and a steady-state response of unity if the input is cos(?r7r). What are the 
values of A and a? 


4.61 (System Response) Find the response of the following filters to the unit step x[n ] = u[n\, and to 
the alternating unit step x[n ] = (—1 ) n u[n}. 

(a) h[n] = <5[n] — 5[n — 1] (differencing operation) 

(b) h[n] = {0.5, 0.5} (2-point average) 

N-l 

(c) h[n] = ^ S[n — k], N = 3 (moving average) 

k =o 

N-l 

(d) h{n] = N (x +1 ) ^ (N — k)S[n — k], N = 3 (weighted moving average) 

k =o 

(e) y[n] — ay[n — 1] = (1 — a)x[n], a = ^=1, N = 3 (exponential average) 


4.62 (Steady-State Response) Consider the following DSP system: 

sampler —> digital filter H(z ) —> ideal LPF 


c(t) 


y(t) 


The input is x(t) = 2 + cos(107rf) + cos(207rf). The sampler is ideal and operates at a sampling rate 

z — 1 

of S Hz. The digital filter is described by H(z ) = OHS'-—. The ideal lowpass filter has a cutoff 

frequency of 0.5S' Hz. 

(a) What is the smallest value of S that will prevent aliasing? 

(b) Let S = 40 Hz and H(z) = 1 + z -2 + z -4 . What is the steady-state output y{t)l 


(c) Let S = 40 Hz and H{z) = 


z 2 + l 
z 4 + 0.5 


. What is the steady-state output y{t)l 


4.63 (Response of Digital Filters) Consider the averaging filter y[n] = 0.5x[n] +x[n — 1] +0.5x[?i— 2], 
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(a) Find its impulse response h[n] and its transfer function H(z). 

4 

(b) Find its response y[n] to the input x[n] = {2,4, 6,8}. 

(c) Find its response y[n] to the input x[n\ = cos} 1 ! 1 ). 

(d) Find its response y[n] to the input x[n] = cos(^) + sin(^p) + cos(^). 

[Hints and Suggestions: For part (b), use convolution. For part (c), find the steady-state response. 

For part (d), add the steady state response due to each component.] 

4 

4.64 (Transfer Function) The input to a digital filter is x[n] = {l, 0.5}, and the response is described 
by y[n] = S[n + 1] — 26[n] — S[n — 1]. 

(a) What is the filter transfer function H{z)l 

(b) Does H(z) describe an HR filter or FIR filter? 

(c) Is the filter stable? Is it causal? 

4.65 (System Analysis) Consider a system whose impulse response is h[n] = (0.5)"u[?r]. Find its response 
to the following inputs. 

(a) x[n] = c5[n] (b) x[ri\ = u[n\ 

(c) x[n] = (0.25) n it[n] (d) x[n] = (0.5)"«[n] 

(e) x[n\ = cos(n7r) (f) x[n] = cos(n7r)u[n] 

(g) x[n] = cos(0.5n7r) (h) x[n] = cos(0.5n7r)'u[n] 

[Hints and Suggestions: For parts (e) and (g), the output is the steady-state response y ss [n]. For 
parts (f) and (h) use y[n} = K(0.5) n + y ss [n] with y[— 1] = 0 and find K.] 

4.66 (System Analysis) Consider a system whose impulse response is h[n] = n(0.5)™u[n]. What input 
x[n] will result in each of the following steady-state outputs? 

(a) y[n\ = cos(0.5ri7r) 

(b) y[n] = 2 + cos(0.5?r7r) 

(c) y[n] = cos 2 (0.25?17t) 

[Hints and Suggestions: For (a), assume x[n ] = Acos(0.5?r7r) + B sin(0.5n7r) and compare the 
resulting steady state response with y[n]. For (b), assume x[n\ = C + Acos(0.5n7r) + B sin(0.5n7r). For 
(c), note that cos 2 a = 0.5 + 0.5 cos 2a.} 

4.67 (System Response) Consider the system y[n] — 0.25 y[n — 2] = x[n\. Find its response j/[n], using 
^-transforms, for the following inputs. 

(a) x[n] = 25[n — 1] + u[n] (b) x[n] = 2 + cos(0.5n7r) 

[Hints and Suggestions: For part (a), find Y(z) and its inverse transform by partial fractions. For 
part (b), add the steady state response for each component of the input.] 

4.68 (System Response) The signal x[n] = (0.5)"w[?r] is applied to a digital filter, and the response is 
y[n]. Find the filter transfer function and state whether it is an HR or FIR filter and whether it is a 
linear-phase filter if the system output y[n] is the following: 

(a) y[n] = <5[n] + 0.5(5[n — 1] 

(b) y[n] = c5[n] — 2S[n — 1] 

(c) y[n\ = (—0.5)"u[?r] 
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4.69 (Interconnected Systems) Consider two systems whose impulse response is hi[n] = c)[?r] +a5[n— 1] 
and h 2 [n] = (0.5) n u[n]. Find the overall system transfer function and the response y[n] of the overall 
system to the input x\vt\ = (0.5)"it[n], and to the input x[n} — cos(?r7r) if 

(a) The two systems are connected in parallel with a = 0.5. 

(b) The two systems are connected in parallel with a = —0.5. 

(c) The two systems are connected in cascade with a = 0.5. 

(d) The two systems are connected in cascade with a = —0.5. 

4.70 (Interconnected Systems) The transfer function H(z) of the cascade of two systems H\{z) and 

z 1 + 0.25 

H- 2 (z ) is known to be H{z) = ^-q^- b a ^ so known that the unit step response of the first system 

is [2 — (0.5)"]w[n]. Determine Hi(z) and H 2 (z). 

4.71 (Feedback Systems) Consider the filter realization of Figure P4.71. Find the transfer function H(z) 
of the overall system if the impulse response of the filter is given by 

(a) h[n] = <5[?r] — <5[n — 1]. (b) h[n] = 0.5<5[n] + 0.5<5[n — 1]. 

Find the difference equation relating y[n] and x[n\ from H(z) and investigate the stability of the overall 
system. 



Figure P4.71 Filter realization for Problem 4.71 

4.72 (Systems in Cascade) Consider the following system: 

x[n] —► Hx(z) —> H 2 (z) —> H 3 (z) —> y[n] 

A(z oil 

It is known that h\[n\ = 0.5(0.4) n u[?t], H- 2 {z) = —-—and h 3 [n] = <5[n] + 0.5(5[n — 1], Choose A , 

z ~ t - fj 

a, and [3 such that the overall system represents an identity system. 

[Hints and Suggestions: Set up Hi(z)H 2 (z)H 3 (z) = 1 to find the constants.] 

4.73 (Recursive and Non-Recursive Filters) Consider two filters described by 

(1) h[n] = {1, 1, 1} (2) y[n] - y[n - 1] = a;[n] - x[n - 3] 

(a) Find the transfer function of each filter. 

(b) Find the response of each filter to the input a;[n] = cos(n7r). 

(c) Are the two filters related in any way? 


4.74 (Feedback Compensation) Feedback compensation is often used to stabilize unstable filters. It is 

required to stabilize the unstable filter G(z) = - by putting it in the forward path of a negative 

z — 1.2 

Ot 

feedback system. The feedback block has the form H(z) = -—. 

(a) What values of a and (3 are required for the overall system to have two poles at z = 0.4 and 
2 = 0.6? What is the overall transfer function and impulse response? 
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(b) What values of a and (3 are required for the overall system to have both poles at z = 0.6? What is 
the overall transfer function and impulse response? How does the double pole affect the impulse 
response? 


[Hints and Suggestions: For the negative feedback system, the overall transfer function is given by 

T ( Z ) = l+G(z)H(z)'} 


4.75 (Recursive Forms of FIR Filters) An FIR filter may always be recast in recursive form by the 
simple expedient of including poles and zeros at identical locations. This is equivalent to multiplying 
the transfer function numerator and denominator by identical factors. For example, the filter H(z) = 
1 — z -1 is FIR but if we multiply the numerator and denominator by the identical term 1 + z the 
new filter and its difference equation become 


H n {z) 


(1 — 2 ; ~ 1 )(1 + z -1 ) 
1 + 2 _1 


I -*" 2 
1 + 2- 1 


y[n] + y[n — 1] = x[n] — x[n — 2] 


The difference equation can be implemented recursively. Find two different recursive difference equa¬ 
tions (with different orders) for each of the following filters. 


( a ) 

(b) 

(c) 


h[n\ = {1, 2, 
z 


1 } 


2 -2z+l 


H{z) = 
y[n] = x[n] — x[n — 


2 ] 


[Hints and Suggestions: Set up H(z) and multiply both numerator and denominator by identical 
polynomials in z (linear, quadratic etc). Use this to find the recursive difference equation.] 


COMPUTATION AND DESIGN 


4.76 (System Response in Symbolic Form) The Matlab based routine sysresp2 (on the author’s 
website) returns the system response in symbolic form. Obtain the response of the following filters and 
plot the response for 0 < n < 30. 

(a) The step response of y[n] — 0.5 y[n — 1] = x[n] 

(b) The impulse response of y [n] —0.5 y[n — 1] = x[n\ 

(c) The zero-state response of y[n] — 0.5 y[n — 1] = (0.5)”u[n] 

(d) The complete response of y[n] — 0.5 y[n — 1] = (0.5)"n[n], y[— 1] = —4 

(e) The complete response of y[n] + y[n — 1] + 0.5 y[n — 2] = (0.5)”«[n], y[— 1] = —4, y[— 2] = 3 

4.77 (Steady-State Response in Symbolic Form) The Matlab based routine ssresp (on the author’s 
website) yields a symbolic expression for the steady-state response to sinusoidal inputs. Find the 
steady-state response to the input x[n] = 2cos(0.2n7r — |) for each of the following systems and plot 
the results over 0 < n < 50. 

(a) y[n] — 0.5 y[n — 1] = x[n\ 

(b) y[n] + y[n — 1] + 0.5 y[n — 2] = 3 x[n] 
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FREQUENCY DOMAIN 

ANALYSIS 


5.0 Scope and Objectives 

This chapter develops the discrete-time Fourier transform (DTFT) as an analysis tool in the frequency 
domain description of discrete-time signals and systems. It introduces the DTFT as a special case of the 
2 -transform, develops the properties of the DTFT, and concludes with applications of the DTFT to system 
analysis and signal processing. 


5.1 The DTFT from the ^-Transform 

The 2 -transform describes a discrete-time signal as a sum of weighted harmonics z 


X(z) = x[k]z k = x[k] (re^ 2vF ) k (5.1) 

k ——oo k =—oo 

where the complex exponential 2 = re j27rF = re includes a real weighting factor r. If we let r = 1, we 
obtain 2 = and z~ k = e~ : > 27TkF = e~^ kn . The expression for the 2 -transform then reduces to 

OO OO 

X(F) = Y x[k]e^ i2vkF Y(n) = Y x[k]e~ jkU (5.2) 

k ——00 k——oo 

The quantity X(F) (or X(f2) is now a function of the frequency F (or fi) alone and describes the discrete¬ 
time Fourier transform (DTFT) of x[n] as a sum of weighted harmonics e~ j27rfeF = . The DTFT is a 

frequency-domain description of a discrete-time signal. The DTFT of x[n] may be viewed as its 2 -transform 
X ( 2 ) evaluated for r = 1 (along the unit circle in the 2 -plane). The DTFT is also called the spectrum 
and the DTFT H(F) of the system impulse response is also referred to as the frequency response or the 
frequency domain transfer function. 

Note that X(F) is periodic in F with unit period because X(F) = X(F + 1) 

OOOO OO 

X(F+ 1)= Y x[k}e~ j2vk{F+1) = Y x[k]e- j2kn e~ j2nkF = Y x[k]e~ j2 * kF = X(F) 

k =—00 k =—00 k =—00 

The unit interval —0.5 < F < 0.5 (or 0 < F < 1) defines the principal period or central period. 
Similarly, X(f2) is periodic in Q with period 27 t and represents a scaled (stretched by 2-7 t) version of X(F). 
The principal period of X(fl) corresponds to the interval —n < Q < n or 0 < fl < 27 t. 
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The inverse DTFT allows us to recover x [n] from one period of its DTFT and is defined by 


x[n] 



X(F)e j2 ™ F dF 


(the F-form) 


x[n] 



(the fl-form) (5.3) 


We will find it convenient to work with the F-form, especially while using the inverse transform relation, 
because it rids us of factors of 2n in many situations. The discrete signal x\n\ and its discrete-time Fourier 
transform X(F) or X(Cl) form a unique transform pair, and their relationship is shown symbolically using 
a double arrow: 


x\n\ 


DTFT 


X(F) 


or 


x\n\ 


DTFT 


X(Q) 


(5.4) 


REVIEW PANEL 5.1 

The DTFT Is a Frequency-Domain Representation of Discrete-Time Signals 


Form 

DTFT 


Inverse DTFT 


OO 


7-1/2 

F-form 

X(F)= J2 

x[k}e~^ kF 

x[n]= / X{F)e j2mF cLF 


k =—oo 

OO 


J- 1/2 

fl-form 

xm= E 

V ,— 

x[k]e- jkn 

x[n] = — f X{Cl)e jnn dCl 

2 TT 


5.1.1 Symmetry of the Spectrum for a Real Signal 

The DTFT of a real signal is, in general, complex. A plot of the magnitude of the DTFT against frequency 
is called the magnitude spectrum. The magnitude of the frequency response H{F) is also called the 
gain. A plot of the phase of the DTFT against frequency is called the phase spectrum. The phase spectrum 
may be restricted to a 360° range (—180°, 180°). Sometimes, it is more convenient to unwrap the phase (by 
adding/subtracting multiples of 360°) to plot it as a monotonic function. The DTFT X(F) of a signal x[n] 


may be expressed in any of the following ways 

X(F) = R(F) + jl(F) = \X(F)\e-’^ F " > = |A(F)|/0(F) (the F-form) (5.5) 

X(Cl) = R(Cl) + jl(Cl) = \X(Cl)\e jHn) = \X(n)\l<j)(n) (the fi-form) (5.6) 

For a real signal, the DTFT shows conjugate symmetry about F = 0 (or 0 = 0) with 

X(F) = X*(—F) |A(F)| = |A(-F)| 0(F) = -0(-F) (the F-form) (5.7) 

X(Cl) = X*(-Cl) |A(0)| = |X(—0)1 0(0) = -0(-fi) (the O-form) (5.8) 


Conjugate symmetry of X(F) about the origin means that its magnitude spectrum displays even symmetry 
about the origin and its phase spectrum displays odd symmetry about the origin. It is easy to show that 
X(F) also displays conjugate symmetry about F = 0.5. Since it is periodic, we find it convenient to plot just 
one period of X(F) over the principal period (—0.5 < F < 0.5) with conjugate symmetry about F = 0. We 
may even plot X(F) over (0 < F < 1) with conjugate symmetry about F = 0.5. These ideas are illustrated 
in Figure 5.1. 

Similarly, X(fl) shows conjugate symmetry about the origin Cl = 0, and about SI = tt, and may also 
be plotted only over its principal period (— n < Q < tt) (with conjugate symmetry about = 0) or over 
(0 < O < 27 r) (with conjugate symmetry about Cl = 7r). The principal period for each form is illustrated in 
Figure 5.2. 
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The DTFT is periodic, with period F = 1 
\ Phase 

1.5 F 


Even symmetry about F = 0 
t Phase 


0.5 F 



-0.5 

Odd symmetry about F = 0 



Even symmetry about F = 0.5 
f Phase 



0.5 1 

Odd symmetry about F = 0.5 


Figure 5.1 Illustrating the symmetry in the DTFT spectrum of real signals 


F-formfor X p (F) 

At5 0 0J* F 

—i-1- F 

0 0.5 1 

Principal period 


Cl -form for X p (Cl) 
-k 0 it 

0 k 2n 

Principal period 


Figure 5.2 Various ways of plotting the DTFT spectrum 


Cl = 2 k F 


Cl = 2n F 


REVIEW PANEL 5.2 

The DTFT Is Always Periodic and Shows Conjugate Symmetry for Real Signals 
F-form: X(F) is periodic with unit period and conjugate symmetric about F = 0 and F = 0.5. 
£2-form: X(£2) is periodic with period 27r and conjugate symmetric about £2 = 0 and 0 = 7r. 
Plotting: It is sufficient to plot the DTFT over one period (—0.5 < F < 0.5 or —7r < £2 < 7 t). 


DRILL PROBLEM 5.1 


(a) If X(F)\f—^o,2 = 2e J7r / 3 , 

(b) If A(F)| F= _ 0 .2 = 2e^/ 3 
Answers: (a) 2 e _ ■ ?7r / 3 ) 2 e- J 

find X(F)\f=o.2, A(F)(p = o.s- 
, find X(F)| f= 3 .2, A(F)|f = 5.8. 
n / 3 (b) 2e~ jn / 3 , 2 e J7r / 3 


If we know the spectrum of a real signal over the half-period 0 < F < 0.5 (or 0 < £2 < 7r), we can use 
conjugate symmetry about the origin to obtain the spectrum for one full period and replicate this to generate 
the periodic spectrum. For this reason, the highest useful frequency present in the spectrum is F = 0.5 or 
£2 = 7T. For sampled signals, this also corresponds to an analog frequency of OAS Hz (half the sampling 
frequency). 

If a real signal x[n] is even symmetric about n = 0, its DTFT X(F) is always real and even symmetric 
in F, and has the form X(F) = A(F). If a real signal x[n\ is odd symmetric, X(F) is always imaginary 
and odd symmetric in F, and has the form X(F) = ±jA(F). A real symmetric signal is called a linear- 
phase signal. The real quantity A(F) (which may not always be positive for all frequencies) is called the 
amplitude spectrum. For a linear-phase signal, it is much more convenient to plot the amplitude (not 
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magnitude) spectrum because its phase is then just zero or just ±90° (and uncomplicated by phase jumps 
of 180° whenever A(F) changes sign). 


REVIEW PANEL 5.3 

The DTFT of Real Symmetric Signals Is Purely Real or Purely Imaginary 


Even symmetric x[n] 
Odd symmetric x[n] 


DTFT 


DTFT 


A(E) or X(S2) (real) 
jA(F) or jA(Q) (imaginary) 


Plotting: It is convenient to plot just the amplitude spectrum A(F) or A(Q). 


DRILL PROBLEM 5.2 

Jf 

(a) Let x[n ] = {3, 1, 3, 4}. Is X(F) periodic? Is X(F) real? Is X(F) conjugate symmetric? 

t 

(b) Let x[n] = {2, 1, 3, 1, 2}. Is X(F) periodic? Is X(F) real? Is X(F) conjugate symmetric? 

4 

(c) Let x[n ] = {2, —1, 0, 1, —2}. Is X(F) periodic? Is X(F) real? Is X(F) conjugate symmetric? 

(d) Let x [n] = {2, —j, 0, j, —2}. Is X(F) periodic? Is X(F) real? Is X(F) conjugate symmetric? 
Answers: (a) Yes, no, yes (b) Yes, yes, yes (c) Yes, no, yes (d) Yes, no, no 


5.1.2 Some DTFT Pairs 

The DTFT is a summation. It always exists if the summand x[n\e^ 2mF = x\n]e^ nFl is absolutely integrable. 
Since \e^ 2mF \ = |e? n °| = 1, the DTFT of absolutely summable signals always exists. The DTFT of 
sinusoids, steps, or constants, which are not absolutely summable, includes impulses (of the continuous 
kind). The DTFT of signals that grow exponentially or faster does not exist. A list of DTFT pairs appears 
in Table 5.1. Both the E-form and fl-form are shown. The transforms are identical (with O = 2ttF), except 
for the extra factors of 27 t in the impulsive terms of the 12-form (in the transform of the constant, the step 
function, and the sinusoid). The reason for these extra factors is the scaling property of impulses that says 
5(F) = 5(£l/2ir) = 2ird(£l). 


REVIEW PANEL 5.4 

Differences Between the E-Form and fi-Form of the DTFT 

If the DTFT contains no impulses: H(F) and ff(fl) are related by = 2ttF. 

If the DTFT contains impulses: Replace 5(F) by 2ir5(fl) (and 2i tF by 0 elsewhere) to get iJ(fl). 


EXAMPLE 5.1 (DTFT from the Defining Relation) 

(a) The DTFT of x[n\ = 5[n] follows immediately from the definition as 

oo oo 

X(F) = ^2 x[k]e- j2nkF = Y, 5[k\e~ j2nkF = 1 


(b) The DTFT of the sequence cc [?x] = {1,0,3,—2} also follows from the definition as 

OO 

X(F) = Y x[k]e~ j2nkF = 1 + 3e~-' 4nF - 2e~ j6nF 


k— — oo 
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Table 5.1 Some Useful DTFT Pairs 


Note: In all cases, we assume |a| < 1. 

Entry 

Signal x[n] 

The F-Form: X(F) 

The O-Form: X({ 2 ) 

1 

S[n] 

1 

1 

2 

a n u[n], \a < 1 

1 

1 - ae-F^F 

1 

1 — ae~ 

3 

na n u[n], \a < 1| 

ae _j27rF 

(1 - ae-F^Fy 

ae-i n 

(1 — ae _jf2 ) 2 

4 

(n+l)a n u[n], a<l 

1 

(1 - ae~^ F y 

1 

(1 — ae _jf2 ) 2 

5 

aW, \ a < 1 

1 — a 2 

1 — a 2 

1 — 2acos(27rF) + a 2 

1 — 2a cos 0 + a 2 

6 

1 

m 

2tt5(0) 

7 

cos(2?r7rF 0 ) = cos(nOo) 

0.5[5(F + F o ) + 5(F-F o )] 

7t[<5(0 + O 0 ) + 5(0 — O 0 )] 

8 

sin(2mrF 0 ) = sin(nOo) 

j0.5[S(F+F o ) -5(F-F 0 )] 

j7r[5(0 + Oo) — <5(0 — Oo)] 

9 

2F c sinc(2nF c ) = 

nir 

"“‘(jf'J 

rect Uj 

10 

u[n] 

0.56(F) + ^ _ e _. 2 ^ F 

7.5(0) + x _ e _. n 


In the O-form, we have 

OO 

X(O) = Y x[k]e~ jkn = 1 + 3e~ j2n - 2e~ m 

k =—oo 

For finite sequences, the DTFT can be written just by inspection. Each term is the product of a sample 
value at index n and the exponential e ~o 2 ' KnF (or e~^ nn ). 


(c) The DTFT of the exponential signal x[n] = a n u[n] follows from the definition and the closed form for 
the resulting geometric series: 

OO OO 1 

X(F) = Y « k e~ i2 * kF = E (chT*™)" = _ ^ |a| < 1 

k—0 k—0 

The sum converges only if \ae~^ 2nF \ < 1, or |a| < 1 (since \e~^ 2irF \ = 1). In the fi-form, 
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X(Q) = J^a k e~ jkQ 

k =0 


oo 




i 

1 — ae~^ ' 


M < 1 


(d) The signal x[n] = u[n\ is a limiting form of a n u[n] as a —> 1 but must be handled with care, since u[n] 
is not absolutely summable. In fact, X(F) also includes an impulse (now an impulse train due to the 
periodic spectrum). Over the principal period, 

X{F) = 1 _ e i j27rF + 0.55(F) (F-form) X(n) = ^ + 7r5(f2) (O-form) 


DRILL PROBLEM 5.3 | 

(a) Let x[n] = {3, 1, 3, 4}. Find X(F) and compute X(F) at F = 0.2. 

(b) Let x [n] = {2, 3, 0, 1}. Find X(F) and compute X(F) at F = 0 and F = 0.5. 

(c) Let x[n] = 8(0.6) n w[n]. Find X(F) and compute X(F) at F = 0, 0.25, 0.5. 

Answers: (a) 2.38e~l 171 ° (b) 6, 2 (c) 20, 6.86e~^ 31 ° , 5 


5.1.3 Relating the z-Transform and DTFT 

The DTFT describes a signal as a sum of weighted harmonics, or complex exponentials. However, it cannot 
handle exponentially growing signals. The ^transform overcomes these shortcomings by using exponentially 
weighted harmonics in its definition. The 2 -transform may be viewed as a generalization of the DTFT to 
complex frequencies. 

For absolutely summable signals, the DTFT is simply the one-sided 2 -transform with z = e j27rF . The 
DTFT of signals that are not absolutely summable almost invariably contains impulses. However, for such 
signals, the 2 -transform equals just the non-impulsive portion of the DTFT, with z = e^ 2jrF . In other words, 
for absolutely summable signals we can always find their ^-transform from the DTFT, but we cannot always 
find their DTFT from the 2 -transform. 


REVIEW PANEL 5.5 
Relating the 2 -Transform and the DTFT 

From X(z) to DTFT: If x[n] is absolutely summable, simply replace 2 by e j27rF (or e J ' f2 ). 
From DTFT to X(z): Delete impulsive terms in DTFT and replace e ?27rF ' (or e- 7 ^) by 2 . 


EXAMPLE 5.2 (The 2 - Transform and DTFT) 

(a) The signal x[n] = a n u[n], |a| < 1, is absolutely summable. Its DTFT equals X p (F) 

1 z 

We can find the 2 -transform of x\n] from its DTFT as T(d = -- = -. 

1 — az 1 z — a 

the DTFT from the 2 -transform by reversing the steps. 


1 

" 1 - ae~F* F ‘ 
We can also find 


(b) The signal x[n] = u[n] is not absolutely summable. Its DTFT is X P (F) = - -+ 0.55(F). 

1 — 6 ^ 

We can find the 2 -transform of u\n\ as the impulsive part in the DTFT, with e j27ri? = z, to give 
1 z 

X(z) = -t- = -. However, we cannot recover the DTFT from its 2 -transform in this case. 

1 — 2 -i 2 — 1 
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5.2 Properties of the DTFT 


The properties of the DTFT are summarized in Table 5.2. The proofs of most of the properties follow from 
the defining relations if we start with the basic transform pair x[n\ 


DTFT 


X{F). 


Table 5.2 Properties of the DTFT 


Property 

DT Signal 

Result (F-Form) 

Result (fl-Form) 

Folding 

x[—n] 

X(-F) = X*{F) 

x(-n) = x*(n) 

Time shift 

x[n — to] 

e -j2*mF X ( F j 

e -jQm X ( Q) 

Frequency shift 

e i 27TnFo x[n\ 

X{F - F 0 ) 

* 

o 

Half-period shift 

(— l) n x[n] 

X(F — 0.5) 

X(fi-7T) 

Modulation 

cos(27rnFo)a;[n] 

0.5[X(F + Fo) + X(F — Fo)] 

o.5[(h + h 0 ) + a:(h-Ho)] 

Convolution 

x[n\*y[n\ 

X(F)Y(F) 

X(fl)Y(fl) 

Product 

x[n]y[n] 

X(F)®Y(F) 

X[X(Q)®Y(Q)} 

Times-?r 

nx[n] 

j dX(F) 

.dX(Q) 

2tt dF 

J dn 

Parseval’s relation 

E ^ 2 [fc] = ^|A(F)| 2 dF=i-^ |A(H)| 2 dH 

Central ordinates 

x[0\= [ X{F)dF = [ X(Cl) dCl X(0)= V x l n ] 

A n=—oo 


OO 

X(F) = X(Sl) = E (-!)"*[»] 

F— 0.5 0=7r 71 ——oo 


5.2.1 Folding 

With x[n\ <= | dtft) =» X(F), the DTFT of the signal y[n ] = x[—n] may be written (using a change of 
variable) as 

oo oo 

Y(F)= J2 x[-k]e~ j2k7rF J2 x[m}e j2m7rF = X(-F) (5.9) 

k =—oo rrl ——k m =—oo 

A folding of x[n] to x[—n\ results in a folding of X(F) to X(—F). For real signals, X(—F) = X*(F) implying 
an identical magnitude spectrum and reversed phase. 


REVIEW PANEL 5.6 

Folding x[n] to x[— n) Results in Folding X{F) to X{—F) 

The magnitude spectrum stays the same, and only the phase is reversed (changes sign). 
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DRILL PROBLEM 5.4 

(a) Let X(F ) = 4 — 2e~^ A ' nF . Find the DTFT of y[n] = x[— n] and compute at F = 0.2. 

(b) For a signal x[n], we find A(F)|f=o .2 = 2e _J71 '/ 3 . Compute the DTFT of y[n] = x[—n] at F = 0.2, 1.8. 

Answers: (a) 4 — 2e- j47rF , 5.74e _J ' 12 ° (b) 2e- 77r / 3 , 


5.2.2 Time Shift of x[n 


With x[n\ 
variable) as 


DTFT 


X(F), the DTFT of the signal y[n\ 


x[n — to] may be written (using a change of 


OO 

Y(F)= Y x[k - m}e~ j2k7rF 

k =—oo 



l—k—m 


oo 

Y x[l}e- j2 V +m)nF 

l =—OO 


X(F)e~ j2 ' ,rmF 


(5.10) 


A time shift of x[n] to x[n — to] does not affect the magnitude spectrum. It augments the phase spectrum 
by 9(F) = —27 imF (or 9(fl) = —mfl), which varies linearly with frequency. 


REVIEW PANEL 5.7 


Time Shift Property of the DTFT 

X(F)e~^ mF or X(n)e~ jmQ 


x n — to 


DTFT 


A time delay by to adds a linear-phase component (—27 rmF or —mfl) to the phase. 


DRILL PROBLEM 5.5 

(a) Let X(F) = 4 — 2e _ - j47rF . If y[n] = x[n — 2], compute Y ( F ) at F = 0.2, 0.3. 

(b) If g[n] = h[n — 2], find the phase difference IG(F) — IH(F) at F = 0.2, 0.4. 

Answers: (a) 4e _j47rF — 2e -j87rF , 5.74e J ' 84 °, 3.88e^' 43 ° (b) -144°, -216°. 


5.2.3 Fl’equency Shift of X'(F) 

By duality, a frequency shift of X(F) to X(F — F 0 ) yields the signal x[?i]e- 72 ’ r " F °. 


Half-period Frequency Shift 

If X(F) is shifted by 0.5 to X(F ± 0.5), then x[n] changes to e =Fjn7r = (— l) n x[n]. Thus, samples of x[n) at 
odd index values (n = ±1, ±3, ±5,...) change sign. 


REVIEW PANEL 5.8 


Frequency Shift Property of the DTFT 

x[n]e^ 27inF ° 

(—1 ) n x[n\ < 


DTFT 


DTFT 


> X(F - F 0 ) or X(n - fi 0 ) (Ho = 2 ttF 0 ) 
X(F ± 0.5) or A(H±tt) 


DRILL PROBLEM 5.6 

(a) Let X(F) =4- 2e~ j4nF . If y[n] = (-l) n x[n], compute Y(F) at F = 0.2, 0.4. 

(b) Let X(F) = 4 — 2e _j4 ’ I ' F . If y[n] = (j) n x[?r], compute Y(F) at F = 0.2, 0.4. [Hint: j = e- 7 ’ 1 '/ 2 ] 

Answers: (a) 5.74e j12 , S.SSe - - 729 (b) 2.66e _: ' 26 , 4. 99e^ 22 
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5.2.4 Modulation 

Using the frequency-shift property and superposition gives the modulation property 

X(F + F 0 ) + X(F - F 0 ) 


e j2'KnF 0 _|_ e -j2imF 0 


x[n] = cos(27rnFo)a;[n] 


DTFT 


(5.11) 


Modulation results in a spreading of the original spectrum. 


REVIEW PANEL 5.9 


Modulation by cos(27mFo) : The DTFT Gets Halved, Centered at iFcb and Added 

x(f + f 0 ) + x(f — f 0 ) x{n + n 0 ) + x(n-n 0 ) 


cos(2FnFo)x[n} 


DTFT 


or 


(U 0 = 27tF 0 ) 


DRILL PROBLEM 5.7 

(a) The central period of X(F) is defined by X(F) = 1, |F| < 0.1 and zero elsewhere. Consider the signal 
y[n] = x[n\ cos(0.2n7r). Sketch Y(F) and evaluate at F = 0, 0.1, 0.3, 0.4. 

(b) The central period of X(F) is defined by X(F) = 1, |F| < 0.1 and zero elsewhere. Consider the signal 
y[n] = x[n] cos(0.5?r7r). Sketch Y(F) and evaluate at F = 0, 0.1, 0.3, 0.4. 

(c) The central period of X(F) is defined by X(F) = 1, |F| < 0.25 and zero elsewhere. Consider the 
signal y[n] = x[n] cos(0.2?r7r). Sketch Y(F) and evaluate at F = 0, 0.1, 0.3, 0.4. 

Answers: (a) 0.5, 0.5, 0, 0 (b) 0, 0.5, 0.5, 0 (c) 1, 1, 0.5, 0 


5.2.5 Convolution 

The regular convolution of discrete-time signals results in the product of their DTFTs. This result follows 
from the fact that the DTFT may be regarded as a polynomial in powers of e~^ 2lTF and discrete convolution 
corresponds to polynomial multiplication. If two discrete signals are multiplied together, the DTFT of the 
product corresponds to the periodic convolution of the individual DTFTs. In other words, multiplication in 
one domain corresponds to convolution in the other. 



DRILL PROBLEM 5.8 

(a) Let X(F) = 4 — 2e _ - j47rF . If y[n] = x[n\ *a ;[n], compute Y(F) at F = 0.2, 0.4. 

(b) Let X(F) = 4 — 2e~^ A ' KF . If y[n] = x[n — 2] *#[—n], compute Y(F) at F = 0.2, 0.4. 

(c) The central period of X(F) is defined by X(F) = 1, |F| < 0.2 and zero elsewhere. Consider the signal 
y[n\ = x 2 [n\. Sketch Y(F) and evaluate at F = 0, 0.1, 0.2, 0.3. 

Answers: (a) 32.94e j24 °, 15.06e" J ' 59 ° (b) 32.94e^ 72 °, 15.06e^' 72 ° (c) 0.4, 0.3, 0.2, 0.1 
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5.2.6 The times-n property: 

With x[n] DTFt]=» X(F), differentiation of the defining DTFT relation gives 


= jr (-j2kn)x[k]e-^ F 


k ——oc 


The corresponding signal is (—j2mr)x[n], and thus the DTFT of y[n] = nx[n] is Y(F) = 


2-7T dF 


(5.12) 


REVIEW PANEL 5.11 


The Times-?! Property: Multiply x[n\ by n 


DTFT 


nx \n\ 


DTFT 


3 dX(F) 
2tt dF 


Differentiate the DTFT 

,dX( 0) 


or j 




DRILL PROBLEM 5.9 | 

(a) Let X(F) = 4 — 2e _ - j47rF . If y[n] = nx[n], find Y(F). 

(b) Let X(F) = 4 — 2e _j4 ’ I ' F . If y[n] = nx[n — 2], find Y(F). 

(c) Let X(F) = 4 — 2e _ - j4,rF . If y\n\ = (n — 2)x[n], find Y(F). 

(d) Let X(F) = 4 _ • h y[n) = nx[n], find Y(F). 

Answers: (a) -4e~ j47lF (b) 8e"I 47rF - 8e~ j87TF (c) -8 (d) — P p _ j4nF ^ 2 


5.2.7 Parseval’s relation 

The DTFT is an energy-conserving transform, and the signal energy may be found from either the signal 
x[n ] or from one period of its periodic magnitude spectrum |A(F’)| using Parseval’s theorem 


E x 2 [k} = 


k ——oo 


r 1/2 i 

\X{F)\ 2 dF = 

- 1/2 


27T 


|A(fl)| 2 dO (Parseval’s relation) 


(5.13) 


REVIEW PANEL 5.12 

Parseval’s Theorem: We can Find the Signal Energy from x[n\ or Its Magnitude Spectrum 

OO „l/2 7T 

E = J_ i 2 \x(F)\ 2 dF=-j^\x(n)\ 2 dn 


DRILL PROBLEM 5.10 

(a) Let X(F) = 5, |F| < 0.2 and zero elsewhere in the central period. Find its total signal energy and its 
signal energy in the frequency range |E| < 0.15. 

(b) Let X(F) = - ---Find its signal energy. 

4 — 2e 

Answers: (a) 10, 7.5 (b) 3 
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5.2.8 Central ordinate theorems 

The DTFT obeys the central ordinate relations (found by substituting F = 0 (or Q = 0) in the DTFT or 
n = 0 in the IDTFT. 

/ 1/2 -j n 7V 00 

X(F)dF= — / X(Cl)dCl X(0) = E x[n] (central ordinates) (5-14) 

-1/2 J-« n=—oo 


With F = 0.5 (or il = 7r), we also have the useful result 


= E (- 1 ) n *w ( 5 - 15 ) 

n =—oo 

The central ordinate theorems allow us to find the dc gain (at F = 0) and high frequency gain (at F = 0.5) 
without having to formally evaluate the DTFT. 


X(F) 


= X(C1) 



REVIEW PANEL 5.13 


Central Ordinate Theorems 

1-1/2 1 j- 7T 

x[0]= X(F)dF =—— X(Q)dQ 

J- 1/2 2TTj_ n 

OO OO 

A(0) = E *(F) = X(Q) = E (-!)"*[»] 

n= —oo F —0-5 —7T n=— oo 


DRILL PROBLEM 5.11 

(a) Let X(F) = 5, |F| < 0.2 and zero elsewhere in the central period. Find the value of x[n\ at n = 0. 

(b) Let x[n] = 9(0.8)”u[n]. What is the value of X(F) at F = 0 and F = 0.5. 

4 

(c) What is the dc gain and high-frequency gain of the filter described by h[n] = {1, 2, 3, 4}. 

Answers: (a) 2 (b) 45, 5 (c) 10, 2 


EXAMPLE 5.3 (Some DTFT Pairs Using the Properties) 

(a) The DTFT of x[n] = na n u[n] 1 \a < 1| may be found using the times-?! property as 


X(F) 


_j_d_ 

2t r dF 


1 

1 - ote-i 2 * F 


ae / 27rF 
(1 - ae ~^ F ) 2 


In the fl-form, 


x(n) = j 


. d 


dQ 


1 


1 — ae l" 1 


ae 


-jfi 


(1 — ae~l n ) 2 


(b) The DTFT of the signal x[n] = (n + 1 )a n u[n] may be found if we write x[n] = na n u[n] + a n u[n], and 
use superposition, to give 


X{F) = 


ae 


-j2nF 


1 


1 


In the fl-form, 


A(fl) = 


(1 - ae-i 27lF ) 2 1 - ae~i 27lF (1 - ae~i 2l ' F ) 2 
ae-i n 1 1 


(1 — ae 1 — ae ^ (1 — ae 
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By the way, if we recognize that x[n] = a n u[n] * a n u[n}, we can also use the convolution property to 
obtain the same result. 


(c) To find DTFT of the fV-sample exponential pulse x[n ;] = a n , 0 < jj < N, express it as x[n] = 
a n (u[n] — u[n — iV]) = a n u[n ] — a N a n ~ N u[n — N] and use the shifting property to get 


X(F) 


1 p -j2nFN 

--- a N — - 

1 - ae~^ nF 1 - ae-F^F 


1 - (ae~^ F ) N 

1 - ae-i^F 


In the fl-form, 


X(fl) 


1 

1 — ae~ 


— a 


N 


e~^ N 
1 — ae~ 


1 - (ae~^) N 
1 — ae~^ 


(d) The DTFT of the two-sided decaying exponential x[n] = a' n ', |a| < 1, may be found by rewriting this 
signal as x[n] = a n u[n} + a~ n i t[—n] — <5[n] and using the folding property to give 


X(F) = 


1 - ae-i^F I _ ae j2nF 


-1 


Simplification leads to the result 
X(F)= 


1 — 2acos(27rF) + a 2 


or X(£l) = 


1 — a 2 


1 — 2a cos O + a 2 


(e) (Properties of the DTFT) 

Find the DTFT of x[n ] = 4(0.5) n+3 it[u-] and y[n] = n(0A) 2n u[n]. 

1. For a;[n], we rewrite it as x[n] = 4(0.5) 3 (0.5)”w[n] to get 

0.5 


X(F) = 


1 - 0.5 e-F* F 


or X(fl) = 


0.5 


1 - 0.5e-J° 


2. For y[n], we rewrite it as y[n] = n(0.16) ra n[n] to get 

0.16e _j27ri? 0.16e- J ' n 

1 ( F) “ (1 - 0 . 16 e-F ^)2 or 1 “ (l-0.16e-J n ) 2 


(f) (Properties of the DTFT) 

._. 4 

Let x[n] <= \ dtft | => 2 _ e _ j2nF =X(F). 

Find the DTFT of y[n] = nx[n ], c[n] = x[—n\, g[n\ = x[n] -kx[ri\, and h[n] = (— l) n x[n]. 
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1. By the times-n property, 


Y(F s = = 4 (-i/ 27r )(~J 27re = ~ 4e j27rF 

1 ’ 2 irdF' [ 1 (2 - e -^ F ) 2 (2-e~^ F ) 2 


In the 12-form, 


vfo , _ .d_ Y(a , _ 4(-j/2n)(-j2ne-i a ) _ -4e~^ 

1 (0) 3 Xl X W (2 — e _J °) 2 (2-e-J' n ) 2 


2. By the folding property, 

C(F) = X(-F) = or C(SI) = X(-S!) = 

3. By the convolution property, 


G(F) = X 2 {F) = 


16 


(2 - e -^ F ) 2 

4. By the modulation property, 

H{F) = X(F — 0.5) = 

In the fl-form, 


or G(fi) = X 2 (il) = 


16 


(2 - e - J ' n ) 2 


2 - e -i27r(F-0.5) 2 + e~^ 2nF 


H(Q) =X(Q-tt) = 


2 - e -j(n-7r) 2 + 


(g) (Properties of the DTFT) 

Let X(F) 4= | dtft] =» (0.5)"u[n] = x[n]. Find the time signals corresponding to 

Y(F) = X(F)@X(F) H(F) = X(F + 0A) + X(F-0A) G{F) = X 2 (F) 

1. By the convolution property, y[n\ = x 2 [n] = (0.25)"w[n]. 

2. By the modulation property, h[n] = 2cos(2n7r_F 0 ):r[?r] = 2(0.5)” cos(0.8n7r)u[n] (where F 0 = 0.4). 

3. By the convolution property, g[n\ = x[n\ * x[n] = (0.5)" u[n] * (0.5)u[n] = (n + l)(0.5)"w[n]. 


5.3 The DTFT of Discrete-Time Periodic Signals 

There is a unique relationship between the description of signals in the time domain and their spectra in 
the frequency domain. One useful result is that sampling in one domain results in a periodic extension 
in the other and vice versa. If a time-domain signal is made periodic by replication, the transform of the 
periodic signal is an impulse sampled version of the original transform divided by the replication period. 
The frequency spacing of the impulses equals the reciprocal of the period. For example, consider a periodic 
analog signal x(t) with period T whose one period is X\(t) with Fourier transform X \(/). When x\(t) is 
replicated every T units to generate the periodic signal x(t), the Fourier transform X(f) of the periodic 
signal x(t) becomes an impulse train of the form Xi(kfo)5(f — kfo). The frequency spacing f 0 of the 
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impulses is given by /o = y, the reciprocal of the period. The impulse strengths X- t (kfo) are found by 
sampling (/) at intervals of /o = ^ and dividing by the period T to give ^Xi(kfo)- These impulse 
strengths ^Xi(kfo) also define the Fourier series coefficients of the periodic signal x(t). Similarly, consider 
a discrete periodic signal x[n\ with period N whose one period is Xi[n], 0 < n < N — 1 with DTFT Xi(F). 
When X\ [n\ is replicated every N samples to generate the discrete periodic signal a;[n], the DTFT X(F) of 
the periodic signal x\n\ becomes an impulse train of the form X\(kFo)6(F — kFo). The frequency spacing Fq 
of the impulses is given by F 0 = fr, the reciprocal of the period. The impulse strengths Xi(kF 0 ) are found 
by sampling X-\ ( F) at intervals of F 0 = and dividing by the period N to give jjX\(kFo). Since X\(F) is 
periodic, so too is X(F) and one period of X(F) contains N impulses described by 

i N - 1 

X(F) = — ^ X\(kF 0 )6(F — kF 0 ) (over one period 0 < F < 1) (5.16) 

fc=o 

By convention, one period is chosen to cover the range 0 < F < 1 (and not the central period) in order 
to correspond to the summation index n = 0<n<N — 1. Note that X(F) exhibits conjugate symmetry 
about k = 0 (corresponding to F = 0 or = 0) and k = ^ (corresponding to F = 0.5 or fi = n). 


| REVIEW PANEL 5.14 | 

The DTFT of x[n] (Period N) Is a Periodic Impulse Train (N Impulses per Period) 

If x[n\ is periodic with period N and its one-period DTFT is Xi[n] 4= | DTFT~| =>- X\(F), then 

1 N - 1 

x[n] <= \ DTFt] => X(F) = — ^ Xi(kF 0 )S(F — kF 0 ) (N impulses per period 0 < F < 1) 

fc=o 


EXAMPLE 5.4 (DTFT of Periodic Signals) 

Let one period of x p [n] be given by X\_[n] = {3, 2, 1, 2}, with N = 4. 

Then, Xi(F) = 3 + 2e~^ F + e~ j47rF + 2e~^ F . 

The four samples of Xi(kFo) over 0 < k < 3 are 

Xi{kF 0 ) = 3 + 2e- j27rfe/4 + e~^ kl4 + 2e~ 3M/4 = {8, 2, 0, 2} 

The DTFT of the periodic signal x p [n] for one period 0 < F < 1 is thus 

1 3 

X(F) = - X!(kF 0 )6(F - |) = 26(F) + 0.56(F - \) + 0.5d(F - |) (over one period 0 < F < 1) 

k =0 

The signal x p [n] and its DTFT X(F) are shown in Figure E5.4. Note that the DTFT is conjugate symmetric 
about F — 0 (or k = 0) and F = 0.5 (or k = 0.5 N = 2). 




Figure E5.4 Periodic signal for Example 5.4 and its DTFT 
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DRILL PROBLEM 5.12 

Find the DTFT of a periodic signal x[n\ over 0 < F < 1 if its one period is given by 

(a) xi[n] = {4, 0, 0, 0} (b) xi[n] = {4, 4, 4, 4} (c) x x [n] = {4, 0, 4, 0} 

3 

Answers: (a) ^ 5(F - 0.25 k) (b) 45(F) (c) 25(F) + 25(F - 0.5) 

k =0 


5.3.1 The DFS and DFT 

The discrete Fourier transform (DFT) of the signal X\[n] is defined as the sampled version of its DTFT 

N-l 

X DFT [k]=X 1 (F)\ F=kFo=k/N =Y J ^Me-^ nk/N , k = 0,1,2,,.. ,N - 1 (5.17) 

n— 0 

The A-sample sequence that results when we divide the DFT by N defines the discrete Fourier series 
(DFS) coefficients of the periodic signal x[n] whose one period is X\[n] 

1 1 Ar ~ 1 

*DF S [fc] = xXi{F)\ F=kFo=k/N xMe-^ nk/N , k = 0,1,2,. N - 1 (5.18) 

71=0 

Note that the DFT and DFS differ only by a factor of N with -Xdft[&] = ./VAdfs [&] • The DFS result may 
be linked to the Fourier series coefficients of a periodic signal with period T 

X[k\ = i f T Xl (t)e~^ kt ' T dt 
1 Jo 

Here, x\ (f) describes one period of the periodic signal. The discrete version of this result using a sampling 
interval of t s allows us to set t = nt s . dt = t s and X\ (t) = Xi(nT s ) = X\ [n]. Assuming N samples per period 
(T = Nt s ), we replace the integral over one period (from t = 0 to t = T) by a summation over N samples 
(from n = 0 to n = N — 1) to get the required expression for the DFS. 


| REVIEW PANEL 5.15 | 

The DFT Is a Sampled Version of the DTFT 

If Xi[n) is an A-sample sequence, its A-sample DFT is Adft[&] = Xi(F)\ F=k / N , k = 0,1, 2, ..., N — 1 
The DFS coefficients of a periodic signal x[n] whose one period is x\ [n] are Adfs[^’] = ^ATdft^'] 


EXAMPLE 5.5 (The DFT, DFS and DTFT) 

Let X\[n] = {1, 0, 2, 0, 3} describe one period of a periodic signal x[n\. 

The DTFT of x x [n] is Ai(F) = 1 + 2e~ j4nF + 3e~ j87TF . 

The period of x[n] is N = 5. The discrete Fourier transform (DFT) of X\ [n] is 


A D FT[fc] = x ± (F) F=k/N 


1 + 2e-^ F + 3e~ jSnF 


F-k/5 


k = 0,1,...,4 


We find that 


A DF T[fc] = {6, 0.3090 + ^1.6776, -0.8090 + j3.6655, -0.8090 - j3.6655, 0.3090-^1.6776} 
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The discrete Fourier series (DFS) coefficients of x[n] are given by XoFs[fc] = ^XdftW- We get 

Xr>Fs[k) = {1.2, 0.0618 +jO.3355, -0.1618 + j0.7331, -0.1618 - jO. 7331, 0.0618 - j0.3355} 

The DTFT X(F) of the periodic signal x[n ], for one period 0 < F < 1, is then 

i 4 

X(F) = - ^ -Xi(|)<S(.F — |) (over one period 0 < F < 1) 

5 k =o 

Note that each of the transforms Xdfs^’K Wdft [fc], and X(F) is conjugate symmetric about both k = 0 
and k = 0.5 N = 2.5. 


DRILL PROBLEM 5.13 








Find the DFT of the following 

signals 


A 
= {4, 




= {4, 4, 0, 0} 

(a) x[n] = {4, 0, 

0, 0} 

(b) x[n] 

4, 4, 

4} 

(c) x[n] 


4 







Answers: (a) {4, 4, 4, 4} 

(b) {16, 

o 

cT 

o' 

(c) {8, 4- 

o' 

'^5 

1 

4 + j4} 



5.4 The Inverse DTFT 

For a finite sequence X(F) whose DTFT is a polynomial in e j27rF (or e jF2 ), the inverse DTFT x[n] corresponds 
to the sequence of the polynomial coefficients. In many other situations, X{F) can be expressed as a ratio 
of polynomials in e j27rF (or e jf2 ). This allows us to split X(F) into a sum of simpler terms (using partial 
fraction expansion) and find the inverse transform of these simpler terms through a table look-up. In special 
cases or only as a last resort, if all else fails, do we need to resort to the brute force method of finding the 
inverse DTFT by using the defining relation. Some examples follow. 


EXAMPLE 5.6 (The Inverse DTFT) 

(a) Let X(F) = 1 + 3e" 4 ' 47rF - 2e~ j67TF . 

Its IDFT is simply x[n] = <5[n] + 3<f[n — 2] — 2 S[n — 3] or x[n] = {l, 0, 3, —2}. 


2e - J n 

(b) Let X(Q) = -——-We factor the denominator and use partial fractions to get 

1 — 0.25e 

o p-jto 2 2 

^ 1 (l-0.5e-J' n )(l + 0.5e-J n ) 1 - 0.5e-A* 1 + 0.5e“J n 

We then find x[n] = 2(0.5)"u[n] — 2(—0.5)™u[n]. 


(c) An ideal differentiator is described by H(F) = j2irF, |Fj < 0.5. Its magnitude and phase spectrum 
are shown in Figure E5.6C. 
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Figure E5.6C DTFT of the ideal differentiator for Example 5.6(c) 


To find its inverse h[n ], we note that /i[0] = 0 since H(F) is odd. For n / 0, we also use the odd 
symmetry of H(F) in the IDTFT to obtain 

,1/2 ,1/2 
h[n\ = / j2nF[cos(2TrnF) + j sm(2TmF)\ dF = —4n / F sin(27rnF) dF 
J —1/2 JO 

Using tables and simplifying the result, we get 

1 /2 

1 —47r[sin(27rnF) — 27rnFcos(27rnF)] 7 cos(n7r) 

l /o „\o „ 

( 2nn) z 0 n 

Since H(F) is odd and imaginary, h[n} is odd symmetric, as expected. 


(d) A Hilbert transformer shifts the phase of a signal by —90°. Its magnitude and phase spectrum are 
shown in Figure E5.6D. 



Figure E5.6D DTFT of the Hilbert transformer for Example 5.6(d) 


Its DTFT given by H(F) = —jsgn(F), |F| < 0.5. This is imaginary and odd. To find its inverse h[n ], 
we note that /i[0] =0 and 
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5.5 The Frequency Response 


The time-domain response y[n] of a relaxed discrete-time LTI system with impulse response h[n\ to the input 
x[n ] is given by the convolution 

y[n] = x[n\ *h[n] (5.19) 

Since convolution transforms to multiplication, transformation results in 

Y(F) = X(F)H(F) or F(fi) = X(Q)H(Q) (5.20) 


The frequency response or steady-state transfer function then equals 


H(F) 


Y(F) 

X(F) 


or 


H(Q) 


Y(n) 

X(Q) 


(5.21) 


We emphasize that the frequency response is defined only for a relaxed LTI system—either as the ratio 
Y(F)/X(F) (or y(f2)/X(f2)) of the DTFT of the output y[n\ and input x[n], or as the DTFT of the impulse 
response h[n\. The equivalence between the time-domain and frequency-domain operations is illustrated in 
Figure 5.3. 



Figure 5.3 The equivalence between the time domain and frequency domain 


A relaxed LTI system may also be described by the difference equation 

y[n] + Aiy[n — 1] + • • • + A^yln — N] = Box[n] + B\x[n — 1] + • • • + Bmx[ti — M] (5.22) 

The DTFT results in the transfer function, or frequency response, given by 


In the fl-form, 


H(F) = 


H(Q) 


Y(F) 

B 0 + B ie -^ F + ■ 

■ ■ + B M e~^ MF 

(5.23) 

X(F) 

1 + Aie-B^ F + • ■ 

■ + A N e~i 2 * NF 

Y(n) 

_ Bo + B ie -^ + • 

■ ■ + B M e~ jMn 

(5.24) 

X(Q) 

1 + Aie~i Q + ■ ■ 

■ + A N e~i Nn 


The transfer function is thus a ratio of polynomials in e j27rF (or e jn ). 


| REVIEW PANEL 5.16 | 

The Frequency Response Is a Frequency-Domain Description of a Relaxed LTI System 

The transfer function H(F ) equals the transform of the system impulse response h[n\. 

It is also defined as H(F ) = Y(F)/X(F), the ratio of the transformed output and transformed input. 
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EXAMPLE 5.7 (Frequency Response of a Recursive Filter) 

Let y[n] = ay[n — 1] +x[n], 0 < a < 1. To find its frequency response, we transform the difference equation 
and find H(z) as 


H{z) 


Y(z) 

X(z) 


1 

1 — az ~ 1 


Next, we let z = ei 2wF and evaluate H(F) as 


H(F ) 


1 

1 - ae-F^F 


1 

1 — a cos(27 tF) + jot sin(27rF) 


The magnitude and phase of H(F ) then equal 


\H(F)\ 


1 


1/2 


1 — 2acos(27rF) + a 2 


(j(F) = tan 1 


1 — ocos(27tF) 
asin(27rF) 


Typical plots of the magnitude and phase are shown in Figure E5.7 over the principal period (—0.5, 0.5). 
Note the conjugate symmetry (even symmetry of \H(F) \ and odd symmetry of <fi(F)). 



Figure E5.7 Magnitude and phase of H P (F) for Example 5.7 


DRILL PROBLEM 5.15 


(a) Find the frequency response H(F) of the filter described by h[n ] = {4, 0, —2}. 

(b) Find the frequency response H(F) of the filter described by h[n] = 2(0.5) ra ii[ n ] — 

(c) Find the frequency response H(F) of the filter described by y[n] — y[n — 2] = 2a:[n] — 4 x[n — 1]. 

1 J_ 0 K p -j2itF 2 — 4 p-FnF 

Answers: (a) 4 - 2e~^ F (b) - _ ( c ) 


1 _ e -j^F 


5.6 System Analysis Using the DTFT 

In concept, the DTFT may be used to find the zero-state response (ZSR) of relaxed LTI systems to arbitrary 
inputs. All it requires is the system transfer function H(F) and the DTFT X(F) of the input x[n\. We first 
find the response as Y(F) = F(F)X(F) in the frequency domain, and obtain the time-domain response y[n] 
by using the inverse DTFT. We emphasize, once again, that the DTFT cannot handle the effect of initial 
conditions. 


EXAMPLE 5.8 (The DTFT in System Analysis) 
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(a) Consider a system described by y[n\ = ay[n — 1] + x[n\. To find the response of this system to the 

input we first set up the transfer function as H(Q) = -—=r. Next, we find the DTFT of 

1 — ae 

x[n\ as X(S1) = -^ and multiply the two to obtain 

1 — ae~^‘ 

y (fi) = = (1 J e . )0)a 

Its inverse transform gives the response as y[n\ = ( n + 1 )a n u[n\. We could, of course, also use 
convolution to obtain y[n] = h[n] *a;[n] directly in the time domain. 

(b) Consider the system described by y[n ] = 0.5 y[n — 1] + x[n]. Its response to the step x[n\ = Au[n] is 
found using Y(F) = H(F)X(F): 

Y(F) = H(F)X(F) = - 1 F -= + 2 5(F) 

y ’ y ’ y ' 1-0.5 e-^ F [l-e~^ F y _ 

We separate terms and use the product property of impulses to get 

Y = (1 — 0.5e _ f 27rF )(l — e~F^ F ) + 4,5(F) 

Splitting the hrst term into partial fractions, we obtain 

Y ^ = 1 - 0.5 e~3 2 " F + _l-e-^ F + AS(kF \ 

The response y[n] then equals y[n] = —4(0.5 ) n u[n] + 8 u[n\. The first term represents the transient 
response, and the second term describes the steady-state response, which can be found much more 
easily, as we now show. 



5.6.1 The Steady-State Response to Discrete-Time Harmonics 

The DTFT is much better suited to finding the steady-state response to discrete-time harmonics. Since 
everlasting harmonics are eigensignals of discrete-time linear systems, the response is simply a harmonic at 
the input frequency whose magnitude and phase is changed by the system function H(F). We evaluate H(F ) 
at the input frequency, multiply its magnitude by the input magnitude to obtain the output magnitude, and 
add its phase to the input phase to obtain the output phase. The steady-state response is useful primarily 
for stable systems for which the natural response does indeed decay with time. 

The response of an LTI system to a sinusoid (or harmonic) is called the steady-state response and is 
a sinusoid (or harmonic) at the input frequency. If the input is x[n] = Acos(27rF 0 n + 9), the steady-state 
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response is y ss [n] = AHq cos[27rFn + 9 + 0o)]? where Hq and <j>o are the gain and phase of the frequency 
response H(F) evaluated at the input frequency F = Fq. If the input consists of harmonics at different 
frequencies, we use superposition of the individual time-domain responses. 

We can also find the steady-state component from the total response (using ^-transforms), but this defeats 
the whole purpose if all we are after is the steady-state component. 


REVIEW PANEL 5.17 

Finding the Steady-State Response of an LTI System to a Sinusoidal Input 

Input: x[n] = Acos(27rni 7 b + 9) Transfer function: Evaluate H(F) at F = Fq as 
Steady-state output: y ss [n] = AH 0 cos(27r nF 0 + 9 + (j> 0 ) 


EXAMPLE 5.9 (The DTFT and Steady-State Response) 

(a) Consider a system described by y[n] = 0.5 y[n — 1] + x[n}. We find its steady-state response to the 
sinusoidal input x[n\ = 10cos(0.5n7r + 60°). The transfer function H(F) is given by 


H(F) 


1 

1 - 0.5e-J 27rF 


We evaluate H(F) at the input frequency, F = 0.25: 


H(F) 


F= 0.25 


1 

1 - 0 . 5 e -^/ 2 


-= 0 Ay/51 - 26.6° = 0.8944Z - 26.6° 

1 + 0.5j 


The steady-state response then equals 


y ss [n} = 10(0.4v / 5)cos(0.5n7r + 60° - 26.6°) = 8.9443 cos(0.5?r7r + 33.4°) 


Note that if the input was x[n] = 10cos(0.5ri7r + 60°)it[n] (switched on at n = 0), the steady-state 
component would still be identical to what we calculated but the total response would differ and require 
a different method (such as ^-transforms) to obtain. 


(b) Consider a system described by h[n] = (0.8) n w[n]. We find its steady-state response to the step input 
x[n] = 4u[n]. The transfer function H{F) is given by 


H(F) = 


1 


1 - 0.8e-J 27rF 

We evaluate H(F) at the input frequency F = 0 (corresponding to dc): 

1 


H(F) 


F=0 


l-0.f 


= 5 


The steady-state response is then y ss [n] = (5)(4) = 20. 
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(c) Let H(z) = 


22 — 1 


We find its steady-state response to x[n] = 6 u[n]. 


2 1 2 + 0.52+ 0.5' 

With 2 = e-? 27 ^, we obtain the frequency response H(F) as 


H(F) = 


2e j27lF - 1 


e j^ F + 0.5e? 27rF + 0.5 


Since the input is a constant for n > 0, the input frequency is F = 0. 
At this frequency, H(F)\p =0 = 0.5. Then, y ss [n] = (6)(0.5) = 3. 


4 

(d) Design a 3-point FIR filter with impulse response h[n\ = {a, (3 , a} that completely blocks the frequency 
F = | and passes the frequency F = 0.125 with unit gain. What is the dc gain of this filter? 

The filter transfer function is H{F) = ae^ 2nF + (3 + ae _ - j2 ’ rF = (3 + 2acos(27 tF). 

From the information given, we have 

J?(i) = 0 = /?+ 2acos(^) = /3-a H{ 0.125) = 1 =/3 + 2acos(^) = (3 - aV2 

4 

This gives a = f3 = 0.4142 and h[n] = {0.4142, 0.4142, 0.4142}. 

The dc gain of this filter is 17(0) = ]T) h[n] = 3(0.4142) = 1.2426. 


DRILL PROBLEM 5.17 | 

(a) Let H(F ) =4 — 2e _j4 ’ rF . If the input is x[n] = 4cos(0.4n7r), what is the response y[n]. 

(b) A filter is described by h[n] = 2(0.5)"u[n] — S[n\. The input is x[n\ = 1 + cos(0.5?r7r). Find y[n]. 

(c) A filter is described by y[n] = x[n] + ax[n — 1] + (3x[n — 2], Choose the values of a and f3 such that 
the input x[n] = 1 + 4cos(ri7r) results in the output y[n\ = 4. 

Answers: (a) 22.96 cos(0.4n7r + 12°) (b) 3 + cos(0.5n7r + 53°) (c) a = 2, (3= 1 


5.7 Connections 

A relaxed LTI system may be described by its difference equation, its impulse response, its transfer function, 
its frequency response, its pole-zero plot or even its realization. Depending on what is required, one form may 
be better suited that others and, given one form, we should be able to obtain the others using time-domain 
methods and/or frequency-domain transformations. The connections are summarized below: 

1. Given the transfer function H(z ), we can use it directly to generate a pole-zero plot. We can also use 
it to find the frequency response H(F) by the substitution 2 = el 27rF . The frequency response will 
allow us to sketch the gain and phase. The inverse 2 -transform of H{z) leads directly to the impulse 
response h[n\. Finally, if we express the transfer function H(z) = Y(z) / X(z) where X(z) and Y(z) 
are polynomials in 2 , cross-multiplication and inverse transformation can give us the system difference 
equation. The frequency response H(F) may be used to find the system difference equation in a similar 
manner. 

2. Given the system difference equation, we can use the 2 -transform to find the transfer function Ft(z) 
and use H(z) to find the remaining forms. 
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3. Given the impulse response h[n], we can use the 2 -transform to find the transfer function H(z) and 
use it to develop the remaining forms. 

4. Given the pole zero-plot, obtain the transfer function H(z) and use it to find the remaining forms. 
Note that we can find H(z) directly from a pole-zero plot of the root locations but only to within the 
multiplicative gain factor K. If the value of K is also shown on the plot, H(z) is known in its entirety. 

For quick computations of the dc gain and high frequency gain (at F = 0.5) we need not even convert 
between forms. To find the dc gain, 

1. If H(F) is given, evaluate its absolute value at F = 0. 

2. If H(z) is given, evaluate its absolute value at 2 = 1 (because if F = 0, we have 2 = e? 2vF = 

3. If h[n] is given, evaluate | Y2 h MI (by summing the samples). 

4. If the difference equation is given in the form Y2 Ak:y[n — k] = Y^B m x[n — m], evaluate the 
value of the ratio Yl^k/Yl B m (after summing the coefficients on each side). 

Similarly, to find the high frequency gain (at F = 0.5) 

1. If H(F ) is given, evaluate its absolute value at F = 0.5. 

2. If H(z ) is given, evaluate its absolute value at 2 = —1 (because if F = 0.5, we have 2 = e/ 2lxF = —1). 

3. If h[n\ is given, evaluate | l)"/i[n]| (by reversing the sign of alternate samples before summing 

them). 

4. If the difference equation is given in the form Y2 Aky[n — k\ = Y2,B m x[n — m], evaluate the absolute 
value of the ratio J](—l) fe Afc/]T)(—l) fc R m . 


!)• 

absolute 


EXAMPLE 5.10 (System Representation in Various Forms) 

(a) Let y[n] = 0.8 y[n — 1] + 2 x[n}. We obtain its transfer function and impulse response as follows: 


Y ( 2 ) = 0 . 82 _ 1 y( 2 ) + 2X(z) 


H(z) 


Y{z) 

X{z) 


2 

1 - O. 82- 1 


2 2 


2 - 0.8 


h[n] = 2 ( 0 . 8 )"w[n] 


(b) Let h[n] = 5[?r] — 0.4(0.5)"w[n]. We obtain its transfer function as 

TT/ , „ 0.42 0.62 - 0.5 

H{z) = 1 - 


2-0.5 


2-0.5 


We also obtain the difference equation by expressing the transfer function as 

Y{z) 


H{z) = 


X{z) 


0.62 - 0.5 0.6 - 5 z- 1 

or 


2-0.5 


1-0.52 


-1 


and using cross-multiplication to give 

( 2 - 0 . 5 )F( 2 ) = (O. 62 - 0 . 5 )A( 2 ) or (1 - 0.52' 1 )F(2) = (0.6 - 0.52" 1 )A(2) 

The difference equation may then be found using forward differences or backward differences as 
y[n + 1] — 0.5 y[n] = 0.6a;[n + 1] — 0.5x[n] or y[n] — 0.5 y[n — 1] = 0.6a;[n] — 0.5 x[n — 1] 

The impulse response, the transfer function, and the difference equation describe the same system. 
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(c) Let y[n] — 0.6 y[n — 1] = x[n\. 

1 


Its clc gain is 


= 2.5 


11 — 0.6 | 

Its high frequency gain is ^ ^ ^ = 0.625 

Its DTFT gives 

Y(F) - 0.6 e~ j27lF Y(F) = X(F) or 


We thus get the transfer function as 

Y(F) 1 


H(F) = 


X{F) 1 - 0.6 e -F*F 
The system impulse response is thus h[n] = (0.6)"u[n]. 


Y(O) - 0.6e" in Y(O) = X(Q) 


or H( 12) = 


Y(O) 1 

A(O) _ 1 - 0.6e-J° 


(d) Let h[n ] = <5[n] — (0.5)”u[n]. 


Since ^(0.5)" = 


1 


n =0 


1 - 0.5 


= —2, the dc gain is |1 — 2| = 1 


Similarly, l)"(0.5) n = y^(—0.5) w -—= 2/3, the high frequency gain is |1 — 2/3| = 1/3 

n—0 n—0 1 + °’ 5 

Of course, it is probably easier to find its dc gain and high frequency gain from 77(F). Its DTFT gives 

1 -0.5e~ : > 2 ” F 


In the O-form, 


From this we find 


H ^ 1 1 - 0.5 e-F^F i _ 0.5 e-F*F 

1 -0.5e" in 


77(0) = 1 - 


1 - 0.5e-^ n 1 - 0.5e-J° 


77(F) = or F(F)(1 - 0.5e~-' 2nF ) = X(F)(-0.5e~ j27rF ) 

A(F) 


In the O-form, 


Lf(O) = 


Y(n) 

A(O) 


or Y(0)(1 - 0.5e _J ' n ) = A(O)(-0.5e“ jn ) 


Inverse transformation gives y[n] — 0.5 y[n — 1] = —0.5x[n — 1]. 


(e) Let 77(F) = 1 + 2e~^ F + 2,e~^ F . 

Its dc gain is |1 + 2 + 3| = 6. 

Its high frequency gain is |1 — 2 + 3| = 2. 

Its impulse response is h[n] = <5[n] + 28[n — 1] + 35[n — 2] = {1, 2, 3}. 

Since 77(F) = ^ = 1 + 2e~^ F + 3e~i 47rF , we find 

Y (F) = (1 + 2e~ : ' 2nF + 3 e~ : ’ 4nF )X(F) y[n] = x\n] + 2 x[n — 1] + 3 x[n — 2] 
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5.8 Ideal Filters 

An ideal lowpass filter is described by Hpp(F) = 1, \F\ < Fq over its principal period |F| < 0.5, as shown 
in Figure 5.4. 


Magnitude 


T -F r F r T 
-0.5 0.5 


Figure 5.4 Spectrum of an ideal lowpass filter 


Its impulse response Iipp [n] is found using the IDTFT to give 

r—0.5 Fc rFc 

e j1nnF dF= / 

f 0.5 J— Fc J—Fc 

Simplifying this result, we obtain 


r— 0.5 pFc rFc 

h LP [n]= H LP (F)e j2 ™ F dF= e j2vnF dF= cos(2t xnF)dF = 

J 0.5 J — Fc J — Fc 


sin(27r nF) 


2tt n 


Fc 


—Fc 


sin(27rnF c ) - sin(-27r nF c ) 2 sin(27r nF c ) 2 F c sm(2nnF c ) . . . 

= - WZZ. - = -dZZ- = -dZT75- = 2F c smc(2nF c ) 


2irn 


27rn 


2'irnFc 


(5.25) 


(5.26) 


REVIEW PANEL 5.18 | 

The Impulse Response of an Ideal Lowpass Filter Is a Sine Function 

h[n\ = 2F C sine(2nF c ) 


— n 




1 





F 


n= 0 


-0.5 -F r 


F c 0.5 


5.8.1 Fl’equency Transformations 

The impulse response and transfer function of highpass, bandpass, and bandstop filters may be related to 
those of a lowpass filter using frequency transformations based on the properties of the DTFT. The impulse 
response of an ideal lowpass filter with a cutoff frequency of Fc and unit passband gain is given by 

h[n] = 2F c smc(2nF c ) (5.27) 

Figure 5.5 shows two ways to obtain a highpass transfer function from this lowpass filter. 

The first way is to shift H(F) by 0.5 to obtain Hpi(F) = H(F — 0.5), a highpass filter whose cutoff frequency 
is given by F H i = 0.5 — Fc- This leads to 

h m [n] = (— l) n h[n] = 2(— l) n Fc sinc(2nFc) (with cutoff frequency 0.5 — Fq) (5.28) 

Alternatively, we see that Fh 2 (F) = 1 — H(F ) also describes a highpass filter, but with a cutoff frequency 
given by F H 2 = Fq, and this leads to 

hp 2 [n] = 5[n\ — 2Fc sinc(2nFc) (with cutoff frequency Fc) (5.29) 
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Lowpass filter H(F) Highpass filter H(F— 0.51 Highpass filter l-FI(F) 



-0.5 -F c F c 0.5 -0.5 /0.5 -0.5 -F Q F c 0.5 

0.5-F c 

Figure 5.5 Two lowpass-to-highpass transformations 


Lowpass filter Bandpass filter Bandstop filter 



Figure 5.6 Transforming a lowpass filter to a bandpass or bandstop filter 


Figure 5.6 shows how to transform a lowpass filter to a bandpass filter or to a bandstop filter. 

To obtain a bandpass filter with a center frequency of F 0 and band edges [F 0 — Fc,F 0 + Fc], we simply shift 
H(F) by F 0 to get Hbp(F) = F[(F + F 0 ) + H{F — F 0 ), and obtain 

/iBp[ti] = 2/i[n]cos(27rnF 0 ) = AFq cos(2irnF 0 )sinc(2nFc) (5.30) 

A bandstop filter with center frequency F 0 and band edges [Fo — Fc, F 0 + Fc] can be obtained from the 
bandpass filter using Hbs{F) = 1 — Hbp(F), to give 


^Bs[tt] = <5[n] — h,Bp[n] = 5[n] — AFc cos(2TrnF 0 )smc(2nFc) 


REVIEW PANEL 5.19 

Transformation of a Lowpass Filter h[n] and H(F) to Other Forms 

h[n] = 2Fc sinc(2nJ 7 c); H(F) = vect(F/2Fc) ^hpN = <J[n] — h[n]; FIbp(F) = 1 — H(F) 

hBp[n] = 2/i[n]cos(27rnF 0 ); Hbp{F) by modulation /ibsM = ^I n ] — ^bp M; H B s(F) = 1 — ^bp(^) 
Note: Fc = cutoff frequency of lowpass prototype; F 0 = center frequency (for BPF and BSF) 


EXAMPLE 5.11 (Frequency Transformations) 

Use frequency transformations to find the transfer function and impulse response of 

1. An ideal lowpass filter with a digital cutoff frequency of 0.25. 

2. An ideal highpass filter with a digital cutoff frequency of 0.3. 

3. An ideal bandpass filter with a passband between F = 0.1 and F = 0.3. 

4. An ideal bandstop filter with a stopband between F = 0.2 and F = 0.4. 

(a) For the lowpass filter, pick the LPF cutoff Fc = 0.25. Then, h[n\ = 0.5 sinc(0.5n). 
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(b) For a highpass filter whose cutoff is Fhp = 0.3: 

Pick an LPF with Fq = 0.5 — 0.3 = 0.2. Then, hup[n] = (—l)™(0.4)sinc(0.4?r). 

Alternatively, pick Fc = 0.3. Then, hup[n] = <J[n] — (0.6)sinc(0.6n). 

(c) For a bandpass filter with band edges [F 1 ,F 2 ] = [0.1, 0.3]: 

Pick the LPF cutoff as Fc = F 2 — F 0 = 0.1, F 0 = 0.2. Then, /i B p[n] = 0.4cos(0.4n7r)sinc(0.2n). 

(d) For a bandstop filter with band edges [Fi,F 2 \ = [0.2, 0.4]: 

Pick the LPF cutoff as Fc = F 2 — F 0 = 0.1, F 0 = 0.3. Then, /ipsM = $M — 0.4cos(0.6mr)sinc(0.2n). 


5.8.2 Truncation and Windowing 

An ideal filter possesses linear phase because its impulse response h[n] is a symmetric sequence. It can 
never be realized in practice because h[n) is a sine function that goes on forever, making the filter noncausal. 
Moreover, the ideal filter is unstable because h[n] (a sine function) is not absolutely summable. One way 
to approximate an ideal lowpass filter is by symmetric truncation (about n = 0) of its impulse response 
h[n] (which ensures linear phase). Truncation of h[n] to |n| < N is equivalent to multiplying h[n] by a 
rectangular window Wd[ti ] = 1, |n| < N. To obtain a causal filter, we must also delay the impulse response 
by N samples so that its first sample appears at the origin. 


5.8.3 The Rectangular Window and its Spectrum 

Consider the rectangular window Wd[n] = rect(n/2fV) with M = 2 N + 1 samples. We have 


w d [n\ = rectI ^ ) = { 1, 1, h 1,1, 1, • • •, 1, 1 } 


N ones 


N ones 


Its DTFT has been computed earlier as 


sin(7rMF) Msinc(MF) 
M D ( ’ = sin(TrF) = sinc(F) 


M = 2N + 1 


(5.32) 


(5.33) 


The quantity Wd{F) describes the Dirichlet kernel or the aliased sine function. It also equals the periodic 
extension of sinc(MF) with period F = 1. Figure 5.7 shows the Dirichlet kernel for N = 3, 6, and 9. 

The Dirichlet kernel has some very interesting properties. Over one period, we observe the following: 


1. It has N maxima. The width of the main lobe is 2/M. The width of the decaying positive and negative 

sidelobes is 1 /M. There are 2 N zeros located at the frequencies F = A, ; 'IK 

2. Its area equals unity, and it attains a maximum peak value of M at the origin. Its value at |F| = 0.5 
is +1 (for even N) or —1 (for odd N). Increasing M increases the mainlobe height and compresses 
the sidelobes. The ratio R of the main lobe magnitude and peak sidelobe magnitude, however, stays 
more or less constant, varying between 4 for small M and 1.57T = 4.71 (or 13.5 dB) for very large M. 
As M — > oo, the spectrum approaches a unit impulse. 
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(a) Dirichlet kernel N= 3 



-0.5 0 0.5 

Digital frequency F 


(b) Dirichlet kernel N = 6 



-0.5 0 0.5 

Digital frequency F 


(c) Dirichlet kernel N = 9 


AA A A 

A A AA 

' v v y \ - 

- / V V v > 


-0.5 0 0.5 

Digital frequency F 


Figure 5.7 The Dirichlet kernel is the spectrum of a rectangular window 


5.8.4 The Triangular Window and its Spectrum 

A triangular window may be regarded as the convolution of two rectangular windows. For a rectangular 
window Wd[n\ = rect(n/2N ), we find 

w d [n\*w d [n\= rect (^) * rect (^) = (2IV + l)tri ^ =Mtri^|^, M = 2N + 1 

We may thus express a triangular window Wf[n\ = tri (n/M) in terms of the convolution 

tri (iz) = ~M Wd ^ M = 2N + l (5.34) 


Since convolution in the time domain corresponds to multiplication in the frequency domain, the spectrum 
of the triangular window may be written as 


W f (F) 




sin 2 (7r MF) 
M sin 2 (7r F) 


Msinc 2 (MF) 
sine 2 (F) 


The quantity W f (F) is called the Fejer kernel. Figure 5.8 shows the Fejer kernel for M = 4, 5, and 8. 
Note that the spectrum is always positive. Its area equals unity and it attains a peak value of M at the 
origin. Its value at |F| = 0.5 is 0 (for even M) or 1/M (for odd M). Increasing M increases the mainlobe 
height and compresses the sidelobes. There are M maxima over one period. As M —> oo, the spectrum 
approaches a unit impulse. For a given finite length M, the mainlobe of the Fejer kernel is twice as wide as 
that of the Dirichlet kernel while the sidelobe magnitudes of the Fejer kernel show a faster decay and are 
much smaller. 


5.8.5 The Consequences of Windowing 

Windowing (or multiplication) of the filter impulse response h[n\ by a window w[n] in the time domain 
is equivalent to the periodic convolution of the filter spectrum H(F) and the window spectrum W(F) in 
the frequency domain. If the impulse response an ideal filter given by h[n] = 2Fcsmc(2Fcn) is truncated 
(multiplied) by a rectangular window w,i [ri] , the spectrum of the windowed filter exhibits overshoot and 
oscillations as illustrated in Figure 5.9. This is reminiscent of the Gibbs effect that occurs in the Fourier 
series reconstruction of a periodic signal containing sudden jumps (discontinuities). 

What causes the overshoot and oscillation is the slowly decaying sidelobes of Wd(F ) (the spectrum of 
the rectangular window). The overshoot and oscillation persists even if we increase the window length. 
The only way to reduce and/or eliminate the overshoot and oscillation is to use a tapered window, such as 
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Figure 5.8 The Fejer kernel is the spectrum of a triangular window 


(a) Dirichlet kernel N = 10 



(b) Ideal LPF with F = 0.25 
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(c) Spectrum of windowed LPF 
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Figure 5.9 The spectrum of an ideal filter windowed by a rectangular window 


the triangular window, whose spectral sidelobes decay much faster. If the impulse response h[n] an ideal 
filter is truncated (multiplied) by a triangular window Wf[n], the spectrum of the windowed filter exhibits a 
monotonic response and a complete absence of overshoot, as illustrated in Figure 5.10. All useful windows are 
tapered in some fashion to minimize (or even eliminate) the overshoot in the spectrum of the windowed filter 
while maintaining as sharp a cutoff as possible. The spectrum of any window should have a narrow mainlobe 
(to ensure a sharp cutoff in the windowed spectrum) and small sidelobe levels (to minimize the overshoot 
and oscillation in the windowed spectrum). For a given window length, it is not possible to minimize both 
the mainlobe width and the sidelobe levels simultaneously. Consequently, the design of any window entails 
a compromise between these inherently conflicting requirements. 


| REVIEW PANEL 5.20 | 

Windowing of h[n] in Time Domain Means Periodic Convolution in Frequency Domain 

Windowing makes the transition in the spectrum more gradual (less abrupt). 

A rectangular window (truncation) leads to overshoot and oscillations in spectrum (Gibbs effect). 
Any other window leads to reduced (or no) overshoot in spectrum. 
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(a) Fejer kernel M = 10 
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Figure 5.10 The spectrum of an ideal filter windowed by a triangular window 


CHAPTER 5 PROBLEMS 


5.1 (DTFT of Sequences) Find and simplify the DTFT of the following signals and evaluate at F = 0, 
F = 0.5, and F = 1. 

(a) x[n] = {1,2,3, 2,1} (b) y[n] = {-1,2,0, -2,1} 

(c) g[n] = {1,2,2,1} (d) h[n] = {-1, -2, 2,1} 

[Hints and Suggestions: Use e+ e~i 8 = 2 cos 6 and e> e — e~i 8 = j 2 sin 9 to simplify the results. 
In (c)-(d), extract the factor e - - ,37rF before simplifying.] 

5.2 (DTFT from Definition) Use the defining relation to find the DTFT X(F) of the following signals. 

(a) x[n} = (0.5) n+2 w[n] (b) x[n] = n(0.5) 2 "u[n] (c) x[n] = (0.5)” +2 u[n — 1] 

(d) x[n] = n(0.5) n+2 u[n — 1] (e) x[n] = (n+ l)(0.5) n u[n] (f) x[n] = (0.5) _ "u[—n] 

[Hints and Suggestions: Pick appropriate limits in the defining summation and simplify using tables. 
For (a), (c) and (d), (0.5) n+2 = (0.25)(0.5) n . For (b), (0.5) 2 ™ = (0.25) n . For (e), use superposition. 
For (f), use the change of variable n —> — n.} 

4 

5.3 (Properties) The DTFT of x[n] is X(F) = - - _ , 2 F . Find the DTFT of the following signals 

without first computing x[n}. 

(a) y[n] = x[n — 2] (b) d[n\ = nx[n\ 

(c) p[n] = x[— n] (d) g[n] = x[n] — x[n — 1] 

(e) h[n} = x[n] *x[n] (f) r[n] = x[n]e :in7T 

(g) s[n] = a’[n]cos(n7r) (h) v[n] = x[n — 1] + x[n + 1] 

[Hints and Suggestions: Use properties such as shifting for (a), times-n for (b), folding for (c), 
superposition for (d) and (h), convolution for (e), frequency shift for (f), and modulation for (g).[ 

5.4 (Properties) The DTFT of the signal x[n] = (0.5)"u[n] is X(F). Find the time signal corresponding 
to the following transforms without first computing X(F). 
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(a) Y(F) = X(-F) (b) G(F) = X(F - 0.25) 

(c) H(F) = X(F + 0.5) + X(F - 0.5) (d) P(F) = X\F) 

(e) R(F) = X\F) (f) S(F) = X(F)®X(F) 

(g) D(F) = X(F)cos(4ttF) (h) T(F) = X(F + 0.25) - X(F - 0.25) 

[Hints and Suggestions: Use properties such as folding for (a), frequency shift for (b), superposition 
for (c) and (h), times-n for (d), convolution for (e), multiplication for (f), and modulation for (g).] 

5.5 (DTFT) Compute the DTFT of the following signals. 

(a) x[n] = 2 ~ n u[n] (b) y[n ] = 2 n u[—n\ 

(c) g[n] = 0.5l"l (d) h[n\ = 0.5l"l(u[n + 1] — u[n — 2]) 

(e) p[n] = (0.5)" cos(0.5n7r)w[n] (f) q[n] = cos(0.5?r7r)('u[n + 5] — u[n — 6]) 

[Hints and Suggestions: In (a), 2 _ " = (0.5)". In (b), use the folding property on x[n\. In (c), 
x[n] = (0.5)"w[n] + (0.5) _ "'ii[—n[— <5[n[. In (d), find the 3-sample sequence first. In (e), use modulation. 
In (f), use modulation on u[n + 5] — u[n — 6] = rect(0.1?r).] 

5.6 (DTFT) Compute the DTFT of the following signals. 

(a) x[n] = sinc(0.2n) (b) h[n] = sin(0.2n7r) (c) g[n] = sinc 2 (0.2n) 

[Hints and Suggestions: In (a), X(F) is a rect function. In (b), X(F) is an impulse pair. In (c), 
G(F) = X(F)®X(F) is a triangular pulse (the periodic convolution requires no wraparound).] 

5.7 (DTFT) Compute the DTFT of the following signals in the form A(F)e^ F " > and plot the amplitude 
spectrum A(F). 

(a) x[n] = 5{n + 1] + 8{n — 1] (b) x[n\ = 8{n + 1] — 8{n — 1] 

(c) x[n} = S[n + 1] + <5[n] + 8[n — 1] (d) x[n] = u[n + 1] — u[n — 1] 

(e) x[n} = u[n + 1] — u[n — 2] (f) x[n} = u[n\ — u[n — 4] 

[Hints and Suggestions: Use eJ® + e~^ 8 = 2 cos 9 and e^ 8 — e~i 8 = j 2 sin 9 to simplify the results. 

4J. 

In (d), use a:[?i] = {1, 1} and extract before simplifying. In (f), use x[n ] = {1,1,1} and extract 
e -j 2 k f }j e f ore simplifying.] 

5.8 (Properties) The DTFT of a real signal x[n] is X(F). How is the DTFT of the following signals 
related to X{F)1 


(a) 

y[n] 

= x[—n\ 

(b) 

g[n\ -- 

= x[n\ -k x[—n\ 

(c) 

r[n\ 

= a;[n/4] (zero interpolation) 

(d) 

s[n] = 

= (—1 ) n x[n] 

(e) 

h[n\ 

= {j) n x[n] 

(f) 

v[n] - 

= cos{2n'KF G )x[n} 

(g) 

w[n\ 

= cos(n7r)a:[?r] 

(h) 

z[n } - 

= [1 + cos(n7r)]x[n 

(i) 

b[n] 

= (—l)"/ 2 a;[n] 

0) 

p[n] -- 

= e jn7I x[n - 1] 


[Hints and Suggestions: In (c), R(F) is a compressed version. In (d), use frequency shifting. In (e) 
and (i), use frequency shifting with j n = (—l)"/ 2 = e- J " 7r / 2 . In (h), use superposition and modulation. 
In (j), use a time shift followed by a frequency shift.] 

5.9 (Properties) Let x[n] = tri(0.2n) and let X{F) be its DTFT. Compute the following without 
evaluating X(F). 

(a) The DTFT of the odd part of x\n] 

(b) The value of X{F) at F = 0 and F = 0.5 

(c) The phase of X(F) 
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(d) The phase of the DTFT of x[—n] 


r 0.5 


(e) The integral / X(F)dF 


'-0.5 

r 0.5 


/ U.Q 

X(F — 0.5) dF 

-0.5 

(g) The integral 
(h) The derivative 


'—0.5 
p0.5 

/ \X(F)\' 2 dF 

I- 0.5 

dX{F) 
dF 

|2 


(i) The integral 


/»0.5 

dX(F) 

/-0.5 

dF 


dF 


[Hints and Suggestions: For (a), (c) and (d), note that x[n] has even symmetry. In (e), find x[0]. 
In (f), find (—l) n x[n] at n = 0. In (g), use Parseval’s theorem. In (h), use —j2Trnx[n] <t=> X'(F).) 

5.10 (DTFT of Periodic Signals) Find the DTFT of the following periodic signals with N samples per 
period. 

(a) x[n] = (1, 1, 1, 1, 1}, N = 5 (b) x[n] = (l, 1, 1, 1}, N = 4 

(c) x[n] = (—1)" (d) x[n ] = 1 (n even) and x[n ] = 0 (n odd) 

[Hints and Suggestions: Find the iV-sample sequence jjX(F))\F=k/Ni k = 0,1,... N — 1 to set up 

X p (F) = ]T) X[k\6(F — k/N). In part (c), x[n\ = (l, —1}, N = 2. In part (d), x[n] = {1,0}, N = 2.} 

5.11 (IDTFT) Compute the IDTFT x[n\ of the following X(F) described over |F| < 0.5. 

(a) X{F) = rect(2 F) (b) X(F) = cos(t tF) (c) X(F) = tri(2 F) 

[Hints and Suggestions: In (a), use rect (F/Fq) <t=> 2^81110(27?^). In (b), simplify the defining 
IDTFT relation. In (c), use rect(2F)©rect(2F) = 0.5tri(2F) and the results of (a).] 

5.12 (Properties) Confirm that the DTFT of x [n] = na n «[n], using the following methods, gives identical 
results. 

(a) From the defining relation for the DTFT 

(b) From the DTFT of y[n\ = a n u[n] and the times-n property 

(c) From the convolution result a n u[n] * a n u[n] = (n + l)a n u[n + 1] and the shifting property 

(d) From the convolution result a n u[n] * a n u[n] — (n + l)a n u[n + 1] and superposition 


5.13 (Properties) Find the DTFT of the following signals using the approach suggested. 

(a) Starting with the DTFT of u[n\, show that the DTFT of x[n] = sgn[?r] is X(F) = —j cot(7r F). 

(b) Starting with rect(n/2N) <t=> (2 N + 1) , use the convolution property to find the 

DTFT of x[n] = tv\(n/N). 

(c) Starting with rect(n/27V) (2 N + 1) SlnC ^^p 1)F ^ , use the modulation property to find the 

DTFT of x[n\ = cos(mr/2N)rect(n/2N). 


[Hints and Suggestions: In part (a), note that sgn[?r] = u[?r] — u\—n] and simplify the DTFT result. 
In part (b), start with rect(^) *rect(^) = Mtri(^) where M = 2 N + 1.] 
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5.14 (Spectrum of Discrete Periodic Signals) Sketch the DTFT magnitude spectrum and phase 
spectrum of the following signals over \F\ < 0.5. 

(a) x[n] = cos(0.5n7r) 

(b) y[n] = cos(0.5n7r) + sin(0.25n7r) 

(c) h[n] = cos(0.5n7r)cos(0.25n7r) 

[Hints and Suggestions: Over the principal period, the magnitude spectrum of each sinusoid is an 
impulse pair (with strengths that equal half the peak value) and the phase shows odd symmetry. For 
part (c), use cos a cos [3 = 0.5cos(a + /3) + 0.5cos(a — (3) to simplify h[n\. } 

5.15 (DTFT) Compute the DTFT of the following signals and sketch the magnitude and phase spectrum 
over —0.5 < F < 0.5. 

(a) x[n ] = cos(0.4ri7r) (b) x[n } = cos(0.2n7T + |) 

(c) x[n ] = cos(n) (d) x[n } = cos(1.2n7T + |) 

(e) x[n] = cos(2.4ri7r) (f) x[n ] = cos 2 (2.4ri7r) 

[Hints and Suggestions: Over the principal period, the magnitude spectrum of each sinusoid is an 
impulse pair (with strengths that equal half the peak value) and the phase shows odd symmetry. For 
part (f), use cos 2 a = 0.5 + 0.5 cos 2a and use its frequency in the principal period. ] 

5.16 (DTFT) Compute the DTFT of the following signals and sketch the magnitude and phase spectrum 
over —0.5 < F < 0.5. 

(a) x[n } = sinc(0.2rc) (b) y[n] = sinc(0.2n)cos(0.4n7r) 

(c) g[n] = sinc 2 (0.2n) (d) h[n] = sinc(0.2n)cos(0.1n7r) 

(e) p[n] = sinc 2 (0.2n)cos(0.4n7r) (f) q[n] = sinc 2 (0.2n)cos(0.2n7r) 

[Hints and Suggestions: In (a), X(F) is arect function. In (c), G(F) = X(F)@X(F) is a triangular 
pulse (the periodic convolution requires no wraparound). In (b), (d), (e), and (f) use modulation (and 
add the images if there is overlap).] 

5.17 (System Representation) Find the transfer function H(F) and the system difference equation for 
the following systems described by their impulse response h[n\. 

(a) h[n) = (g)"u[n] (b) h[n] = [1 - (g) n ]w[n] 

(c) h[n\ = n{\) n u[n ] (d) h[n] = 0.5(5[n] 

(e) h[n] = 5[n] - (§)"«[«] (f) h[n) = [(|)" + (§)"]«[«] 

[Hints and Suggestions: For the difference equation, set up H(F) as the ratio of polynomials in 
e -f27r f^ e q Ua ^ e w ith ^(f) > cross-multiply and use the shifting property to convert to the time domain.] 

5.18 (System Representation) Find the transfer function and impulse response of the following systems 
described by their difference equation. 

(a) y[n] + 0Ay[n — 1] = 3 x[n] (b) y[n] — \y[n — 1] — \y[n — 2] = 2 x[n] + x[n — 1] 

(c) y[n] = 0.2x[n] (d) y[n] = x\n ] + x[n — 1] + x[n — 2] 

[Hints and Suggestions: Find H(F) = after taking the DTFT and collecting terms in X(F) 
and Y(F). In (b), evaluate h[n\ after expanding H(F) by partial fractions.] 

5.19 (System Representation) Set up the system difference equation for the following systems described 
by their transfer function. 
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g e j 2 irF 3 e -j r 2irF 

(a) H(F) = 3eJ . 2ffF + x (b) H{F) = g _ i2jrF + 2 - e _ j2vF + 3 
6 6e J ' 2irF + 4e i4,rF 

(c) x _ 0 . 3 e-F-F ( d ) F ( F ) = (i + 2e i 2 - F )(l + 4eJ 2 - F ) 

[Hints and Suggestions: Set up H(F) as the ratio of polynomials in e ~^ 2nF , equate with Yfpy, 
cross-multiply and use the shifting property to convert to the time domain.] 

5.20 (Steady-State Response) Consider the filter y[n] + 0.25y[n — 2] = 2a;[n] + 2 x[n — 1]. Find the filter 
transfer function U( F ) of this filter and use this to compute the steady-state response to the following 
inputs. 

(a) x[n\ = 5 (b) x[n] = 3cos(0.5n7T + f) — 6sin(0.5n7r — |) 

(c) x[n ] = 3cos(0.5n7r)rt[n] (d) x\n] = 2 cos(0.25?r7r) + 3 sin(0.5ri7r) 

[Hints and Suggestions: Set up H(F). For each sinusoidal component, find the frequency Fq, 
evaluate the gain and phase of H(F 0 ) and obtain the output. In (b) and (d), use superposition.] 

5.21 (Response of Digital Filters) Consider the 3-point averaging filter described by the difference 
equation y[n] = |(a;[n] + x[?i — 1 ] + x[n — 2 ]). 

(a) Find its impulse response h[n\. 

(b) Find and sketch its frequency response H(F). 

(c) Find its response to x[n] = cos( n if + |). 

(d) Find its response to x[n\ = cos(^ + f) + sin(^ + |). 

(e) Find its response to x[n] = cos(^ + f) + sin(^ + |). 

[Hints and Suggestions: For (c)-(e), for each sinusoidal component, find the frequency Fg, evaluate 
the gain and phase of H(F 0 ) and obtain the output. In (d) and (e), use superposition.] 

5.22 (Frequency Response) Consider a system whose frequency response H(F) in magnitude/phase 
form is H{F) = A(F)e^^ F \ Find the response y[n] of this system for the following inputs. 

(a) x[n ] = (5[n] (b) x[n ] = 1 (c) x[n ] = cos( 2 n 7 rF 0 ) (d) x[n] = (—l) n 

[Hints and Suggestions: For (d), note that (— l) n = cos(n 7 r).] 

5.23 (Frequency Response) Consider a system whose frequency response is H(F) — 2cos(nF)e~ : ’' KF . 

Find the response y[n] of this system for the following inputs. 

(a) x[n ] = S[n ] (b) x[n ] = cos(0.5?r7r) 

(c) x[n ] = cos(n7r) (d) x[n ] = 1 

(e) x[n] = ei 0 ' 4 ™ (f) x[n] = (j) n 

[Hints and Suggestions: For (a), use 2cos 9 = e^ e + e~^ e and find h[n\. For the rest, evaluate H{F) 
at the frequency of each input to find the output. For (f), note that j = e J ”' 2 .] 

JJ- 

5.24 (Frequency Response) The signal x[n] = { 1 , 0.5} is applied to a digital filter and the resulting 
output is y[n\ = S[n] — 2S[n —l] — 8[n — 2\. 

(a) What is the frequency response H(F) of this filter? 

(b) Find the impulse response h[n] of this filter. 

(c) Find the filter difference equation. 
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[Hints and Suggestions: Set up H(F ) = and cross-multiply to establish the system difference 
equation. Find h[n] by first writing H(F) as the sum of three terms.] 


5.25 (Frequency Response) Consider the 2-point averager y[n] = 0.5x[n] + 0.5a:[?r — 1]. 


( a ) 

(b) 

(c) 

(d) 

(e) 

(f) 


Sketch its amplitude spectrum. 

Find its response to the input x[n] = cos(ri7r/2). 

Find its response to the input x[n] = 8[n}. 

Find its response to the input x[n] = 1 and x[n] = 3 + 2<5[n] — 4cos(ri7r/2). 
ni , . , . , cos _1 (v / (b5) 

Show that its halt-power frequency is given by he = -• 

7T 

What is the half-power frequency of a cascade of N such 2-point averagers? 


[Hints and Suggestions: For (a), extract the factor e J7rF in H(F) to get H(F) = A{F)e^ F ^ and 
sketch A(F). For (b), find h[n]. For (c), evaluate H(F) at the frequency of x[n] to find the output. 
For (d), use superposition. For (e), use |A(F)| = \/ff5. For (f), start with |R)v(F)| = |fF(F)| Ar .] 


5.26 (Frequency Response) Consider the filter of Figure P5.26. Find the frequency response of the 
overall system and the difference equation relating y[n\ and x[n] and examine the system stability if 
the impulse response hi [n] of the filter in the forward path is 


(a) hi[n] = <5[n] — S[n — 1], (b) h\[n ] = 0.5c) [n] + 0.5<f[n — 1]. 


w-r© 


Filter 


y \ n \ 


Figure P5.26 Filter realization for Problem 5.26 

[Hints and Suggestions: Note that y[n\ = (x[n] — y[n — 1]) *fti[n]. Use this to set up the difference 
equation, check stablity and find H(F).] 


5.27 (Interconnected Systems) Consider two systems with impulse response h\[n\ = 8[n] + aS[n — 1] 
and h ‘2 [rt] = (0.5)"tt[n]. Find the frequency response and impulse response of the combination if 

(a) The two systems are connected in parallel with a = 0.5. 

(b) The two systems are connected in parallel with a = —0.5. 

(c) The two systems are connected in cascade with a = 0.5. 

(d) The two systems are connected in cascade with a = —0.5. 


[Hints and Suggestions: In each case, find h[n] for the combination to find H(F). You may also 
work directly in the frequency domain.] 

5.28 (Interconnected Systems) Consider two systems with impulse response hi[n] = 8 [n] + aS[n — 1] 
and /©n] = (0.5)"w[n]. Find the response of the overall system to the input x[n) = cos(0.5?r7r) if 

(a) The two systems are connected in parallel with a = 0.5. 

(b) The two systems are connected in parallel with a = —0.5. 

(c) The two systems are connected in cascade with a = 0.5. 

(d) The two systems are connected in cascade with a = —0.5. 
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[Hints and Suggestions: In each case, find H(F) for the combination and evaluate at the frequency 
of the input to set up the output.] 

5.29 (DTFT of Periodic Signals) Find the DTFT of the following periodic signals described over one 
period, with TV samples per period. 

(a) x[n] = {1, 0, 0, 0, 0}, TV = 5 

(b) x[n] = {1, 0, -1, 0}, TV = 4 

(c) x[n] = {3, 2, 1, 2}, TV = 4 

(d) x[n\ = {l, 2, 3}, TV = 3 

[Hints and Suggestions: Find the TV-sample sequence jjX(F))\p = k/N, fc = 0,1,... TV — 1 to set up 
X p (F) = 'ZX[k]6(F-k/N).] 

5.30 (System Response to Periodic Signals) Consider the 3-point moving average filter described by 
y[n] = x[n ] + x[n — 1] + x[n — 2]. Find one period of its periodic response to the following periodic 
inputs. 

(a) x[n] = {1, 0, 0, 0, 0}, TV = 5 

(b) x[n] = {1, 0, -1, 0}, TV = 4 

(c) x[n] = {3, 2, 1}, TV = 3 

(d) x[n] = {1, 2}, TV = 2 

[Hints and Suggestions: Find h[n ], create its TV-sample periodic extension, and find its periodic 
convolution with the input (you may use regular convolution and wraparound).] 

4 

5.31 (DTFT of Periodic Signals) One period of a periodic signal is given by x[n] = {1, —2, 0, 1}. 

(a) Find the DTFT of this periodic signal. 

(b) The signal is passed through a filter whose impulse response is h[n ] = sinc(0.8n). What is the 
filter output? 

[Hints and Suggestions: In (a), find the TV-sample sequence jjX(F))\ F — k / N , k = 0,1,... TV — 1 to 
set up X p (F) = X[k]5(F — k/N). In (b), h[n ] is an ideal filter that passes frequencies in the range 

—0.4 < F < 0.4 with a gain of 1.25. So, extend X p {F ) to the principal range —0.5 < F < 0.5. Each 
impulse pair in X p (F) (in the principal range) passed by the filter is a sinusoid.] 

5.32 (System Response to Periodic Signals) Consider the filter y[n] — 0.5 y[n — 1] = 2>x[n}. Find its 
response to the following periodic inputs. 

(a) x[n] = {4, 0, 2, 1}, TV = 4 

(b) x[n] = (—1)" 

(c) x[n] = 1 (n even) and x[n\ = 0 (n odd) 

(d) x[n] = 14(0.5) n (u[n] — u[n — (TV + 1)]), TV = 3 

[Hints and Suggestions: h[n] = 3(0.5) n u[n]. Its periodic extension is h p [n ] = 3(0.5)"/(l — 0.5^) 
with period TV. Find the periodic convolution of h p [n\ and one period of x[n] (by regular convolution 

4 4 

and wraparound). For (b), x[n\ = {1,-1} (TV = 2). For (c), x[ri\ = {1,0} (TV = 2).] 
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5.33 (System Response to Periodic Signals) Find the response if a periodic signal whose one period 
is x[n\ = {4, 3, 2, 3} (with period N = 4) is applied to the following filters. 

(a) h[n] = sinc(0.4n) 

(b) H(F) = tri(2F) 

[Hints and Suggestions: Find the iV-sample sequence ^X(F))\ F - k / N , k = 0,1,... N — 1 to set up 
X p (F ) = Y2 X[k\S(F — k/N) and extend to the principal range —0.5 < F < 0.5. Each impulse pair in 
X p (F ) (in the principal range) passed by the filter defines a sinusoid. In (a), H{F) = 2.5rect(F/0.4).] 

5.34 (Sampling, Filtering, and Aliasing) The sinusoid x(t) = cos(27t f 0 t) is sampled at 1 kHz to yield 

the sampled signal x[n]. The signal x[n\ is passed through a 2-point averaging filter whose difference 
equation is y[n\ = 0.5(x[n] +x[n — 1]). The filtered output y[n] is reconstructed using an ideal lowpass 
filter with a cutoff frequency of 0.5 kHz to generate the analog signal y(t). 

(a) Find an expression for y(t) if /o = 0.2 kHz. 

(b) Find an expression for y(t) if /o = 0.5 kHz. 

(c) Find an expression for y(t) if /o = 0.75 kHz. 

[Hints and Suggestions: In part (c), y(t) has a lower frequency lower than 750 Hz due to aliasing.] 

5.35 (The Fourier Transform and DTFT) The analog signal x(t) = e~ at u(t) is ideally sampled at the 

OO 

sampling rate S to yield the analog impulse train Xi(t) = x(t)5(t — kt s ) where t s = 1/S. 

k =—oo 

(a) Find the Fourier transform X(f). 

(b) Find the Fourier transform Xi(f). 

(c) If the sampled version of x(t) is x[n], find the DTFT X(F). 

(d) How is X(F) related to Aj(/)? 

(e) Under what conditions is X(F) related to X(f)7 

[Hints and Suggestions: In (b), x,;(f) = 5(t) + S(t — t s ) + S(t — 2t s ) + ■ ■ ■. So, find Xi(f) and simplify 
the geometric series. In (c), use x[n] = e~ ants u[n ] = ( e~ ats ) n u[n]. In (d), use F = ft s ] 

5.36 (Ideal Filter Concepts) Let Hi(F) be an ideal lowpass filter with a cutoff frequency of F\ = 0.2 
and let H 2 (F) be an ideal lowpass filter with a cutoff frequency of Fi = 0.4. Make a block diagram of 
how you could use these filters to implement the following and express their transfer function in terms 
of Hi{F) and/or F[ 2 {F). 

(a) An ideal highpass filter with a cutoff frequency of Fq = 0.2 

(b) An ideal highpass filter with a cutoff frequency of Fq = 0.4 

(c) An ideal bandpass filter with a passband covering 0.2 < F < 0.4 

(d) An ideal bandstop filter with a stopband covering 0.2 < F < 0.4 

[Hints and Suggestions: In (a), use H(F ) = 1 — H\{F) to set up the block diagram.] 

5.37 (Echo Cancellation) A microphone, whose frequency response is limited to 5 kHz, picks up not only 
a desired signal x(t) but also its echoes. However, only the first echo, arriving after t ( ] = 1.25 ms, has 
a significant amplitude (of a = 0.5) relative to the desired signal x(t). 

(a) Set up an equation relating the analog output and analog input of the microphone. 
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(b) The microphone signal is to be processed digitally in an effort to remove the echo. Set up a 
difference equation relating the sampled output and sampled input of the microphone using an 
arbitrary sampling rate S. 

(c) Argue that if S equals the Nyquist rate, the difference equation for the microphone will contain 
fractional delays and be difficult to implement. 

(d) If the sampling rate S can be varied only in steps of 1 kHz, choose the smallest S that will ensure 
integer delays and use it to find the difference equation of the microphone and describe the nature 
of this filter. 

(e) Set up the difference equation of an echo-canceling system that can recover the original signal 
using the sampling rate of the previous part. Find its frequency response. 

(f) If the microphone is cascaded with the echo-cancelling filter, what is the impulse response of the 
cascaded system? 


[Hints and Suggestions: In (a), y(t) = x(t) + ax(t — to)- In (b), y[n] = x[n] + ax[n — IV] with 
N = Std■ In (d), choose the inverse system y[n] + ay[n — N] = x[n}. In (f), note that Hc{F) = 1.] 

5.38 (Modulation) A signal x[n] is modulated by cos(0.5?r7r) to obtain the signal x\ [n]. The modulated 
signal Xi[n] is filtered by a filter whose transfer function is H(F) to obtain the signal yi[n\. 

(a) Sketch the spectra X(F), X\(F), and Yi(F) if X(F) = tri(4F) and F[{F) = rect(2F). 

(b) The signal yi[n] is modulated again by cos(0.5n7r) to obtain the signal y 2 [n\, and filtered by H(F ) 
to obtain y[n\. Sketch Y 2 (F) and Y(F). 

(c) Are the signals x[n] and y[n] related in any way? 

[Hints and Suggestions: In (a), the output is a version of X(f) truncated in frequency. In (b), the 
output will show sine distortion (due to the zero-order-hold).] 

5.39 (Group Delay) Show that the group delay t g of a filter described by its transfer function H(F) may 
be expressed as 

, ^r(F)H i (F) - Hj(F)H r (F) 

9 2tt\H(F)\ 2 

Here, H(F) = Hji(F)+jHi(F) and the primed quantities describe derivatives with respect to F. This 
result may be used to find the group delay of both FIR and FIR filters. 

JJ, 

(a) Find the group delay of the FIR filter described by h[n\ = {a, 1}. 

(b) Find the group delay of the FIR filter described by H{F) = 1 + ae ? 27ri? . 

(c) For an HR filter described by H(F) = jyfpj;,. the overall group delay may be found as the 

difference of the group delays of N(F ) and D(F). Use this concept to find the group delay of 

Oi T €~ 

the filter given by H(F) = ^ + ae -j 2 izF - 


[Hints and Suggestions: 


Start with t g = — 

Z7T 


1 d4(F) 


dF 


J__d_ 
'2ndF 


tan 


use the given expression to find t g . For (c), use the results from (a) and (b).] 


-1 Hj{F) 
Hr{F) 


For (a) and (b), 
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COMPUTATION AND DESIGN 


5.40 (Interconnected Systems) The signal x[n] = cos(2nFon ) forms the input to a cascade of two 
systems whose impulse response is described by hi[n] = {0.25, 0.5, 0.25} and h 2 [n] = 5[n] — S[n — 1]. 

(a) Generate and plot x[n] over 0 < n < 100 if F 0 = 0.1. Can you identify its period from the plot? 

(b) Let the output of the first system be fed to the second system. Plot the output of the each 
system. Are the two outputs periodic? If so, do they have the same period? Explain. 

(c) Reverse the order of cascading and plot the output of the each system. Are the two outputs 
periodic? If so, do they have the same period? Does the order of cascading alter the overall 
response? Should it? 

(d) Let the first system be described by y[n] = x 2 [n\. Find and plot the output of each system in 
the cascade. Repeat after reversing the order of cascading. Does the order of cascading alter the 
intermediate response? Does the order of cascading alter the overall response? Should it? 

5.41 (Frequency Response) This problem deals with the cascade and parallel connection of two FIR 
filters whose impulse response is given by 

hi[n] = {1, 2, 1} h 2 [n] = {2, 0, -2} 

(a) Plot the frequency response of each filter and identify the filter type. 

(b) The frequency response of the parallel connection of hi [n] and h 2 [n] is Hp\ ( F ). If the second filter 
is delayed by one sample and then connected in parallel with the first, the frequency response 
changes to Hp 2 (F). It is claimed that Hpi(F) and Hp 2 (F) have the same magnitude and differ 
only in phase. Use Matlab to argue for or against this claim. 

(c) Obtain the impulse response ftpi[n] and hp 2 [n] and plot their frequency response. Use Matlab 
to compare their magnitude and phase. Do the results justify your argument? What type of 
filters do h pi [n] and hp 2 [?r] describe? 

(d) The frequency response of the cascade of h-\ [n] and h 2 [n] is Hci(F). If the second filter is delayed 
by one sample and then cascaded with the first, the frequency response changes to Hc 2 {F). It 
is claimed that Hci{F) and Hq 2 {F) have the same magnitude and differ only in phase. Use 
Matlab to argue for or against this claim. 

(e) Obtain the impulse response hci[n] and hc 2 [n] and plot their frequency response. Use Matlab 
to compare their magnitude and phase. Do the results justify your argument? What type of 
filters do hci[n] and hc 2 [n] represent? 

5.42 (Nonrecursive Forms of HR Filters) We can only approximately represent an HR filter by an FIR 
filter by truncating its impulse response to N terms. The larger the truncation index N, the better is 
the approximation. Consider the HR filter described by y[n\ — 0.8 y[n — 1] = x [n]. 

(a) Find its impulse response h[n\. 

(b) Truncate h[n] to three terms to obtain /ijv[n]. Plot the frequency response Ff(F) and Hn{F). 
What differences do you observe? 

(c) Truncate h[n] to ten terms to obtain /qv[n]. Plot the frequency response F[{F) and ffjv(F). 
What differences do you observe? 

(d) If the input to the original filter and truncated filter is x[n\, will the greatest mismatch in the 
response y[n] of the two filters occur at earlier or later time instants n? 
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5.43 (Allpass Filters) Consider a lowpass filter with impulse response h[n] = (0.5)"u[n]. The input to 
this filter is x[n\ = cos(0.2wr). We expect the output to be of the form y[n] = Acos(0.2n7r + 9). 

(a) Find the values of A and 9. 

(b) What should be the transfer function H\(F) of a first-order allpass filter that can be cascaded with 
the lowpass filter to correct for the phase distortion and produce the signal z\n ] = B cos(0.2?r7r) 
at its output? 

(c) What should be the gain of the allpass filter in order that z[n\ = x[n]7 


5.44 


(Frequency Response of Averaging Filters) 

Consider the following averaging filters: 

! N ~' 

Filter 1: y[n\ = — ^ x[n — k] 
fc=o 


The averaging of data uses both FIR and HR filters. 


(iV-point moving average) 


2 iV_1 

Filter 2: y[n] = N( ^ N+l - ) ( N ~ k ^ n ~ k 1 
Filter 3: y[n] — ay[n — 1] = (1 — a)x[n], a = 


(A-point weighted moving average) 
(first-order exponential average) 


(a) Confirm that the dc gain of each filter is unity. Which of these are FIR filters? 

(b) Sketch the frequency response magnitude of each filter with N = 4 and N = 9. How will the 
choice of N affect the averaging? 

(c) To test your filters, generate the signal x[n] = 1 — (0.6)", 0 < n < 300, add some noise, and apply 
the noisy signal to each filter and compare the results. Which filter would you recommend? 
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FILTER CONCEPTS 


6.0 Scope and Objectives 

This chapter introduces the terminology of filters and the time-domain and frequency-domain measures that 
characterize them. It deals with the connections between various techniques of of digital filter analysis. It 
discusses the graphical interpretation of the frequency response and introduces the concept of filter design 
by pole-zero placement. It concludes by describing a variety of filters (such as minimum-phase, allpass, comb 
and notch) that find use in digital signal processing. 


6.1 Frequency Response and Filter Characteristics 

Plots of the magnitude and phase of the transfer function against frequency are referred to collectively as the 
frequency response. The frequency response is a very useful way of describing digital filters. We may often 
get a fair idea of the filter behaviour in the frequency domain even without detailed plots of the frequency 
response. The dc gain (at F = 0 or Q = 0) and the high-frequency gain (at F = 0.5 or O = ir) serve as a 
useful starting point. For a lowpass filter, for example, whose gain typically decreases with frequency, we 
should expect the dc gain to exceed the high-frequency gain. Other clues are provided by the coefficients 
(and form) of the difference equation, the transfer function and the impulse response. The more complex 
the filter (expression), the less likely it is for us to discern its nature by using only a few simple measures. 


REVIEW PANEL 6.1 

Finding the DC Gain and High-Frequency Gain 

From H(z ): Evaluate H(z) at z = 1 (for dc gain) and z = —l (for high-frequency gain). 

From H(F) or Evaluate H(F) at F = 0 and F = 0.5, or evaluate H(fl) at O = 0 and O = ir. 

From impulse response: Evaluate h[n] = H( 0) and ]T)(—1 ) n h[n\ = H(F) |f=o.5 = H(£l) |n =7r . 
From difference equation: For dc gain, take the ratio of the sum of the RHS and LHS coefficients. 
For high-frequency gain, reverse the sign of alternate coefficients and then take the ratio of the sum. 


6.1.1 Phase Delay and Group Delay 

In the frequency domain, performance measures of digital filters are based on the magnitude (gain), phase 
and delay. The phase delay and group delay of a digital filter with transfer function H(f) are defined by 

tp(F 0 ) = (phase delay) t g (F) = --(group delay) (6.1) 
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6.1.2 Minimum-Phase 


Consider a system described in factored form by 

rr ( x = r A Z - ~l)0 - Z A Z - Z 3 ) ■ ■ ■ 0 - z m ) 

K ’ (z- pi )(z-p 2 )(z-p 3 )---(z-p n ) 


( 6 . 2 ) 


If we replace K by — K, or a factor (z — a) by — a) or by x ~ z az or by (1 — az), the magnitude of 
\H p (F)\ remains unchanged, and only the phase is affected. If K > 0 and all the poles and zeros of H(z) 
lie inside the unit circle, H(z) is stable and defines a minimum-phase system. It shows the smallest 
group delay (and the smallest deviation from zero phase) at every frequency among all systems with the 
same magnitude response. A stable system is called mixed phase if some of its zeros lie outside the unit 
circle and maximum phase if all its zeros lie outside the unit circle. Of all stable systems with the same 
magnitude response, there is only one minimum-phase system. 


All Poles and Zeros of a Minimun 

REVIEW PANEL 6.2 

i-Phase System Lie Insi< 

de the Unit Circle 



EXAMPLE 6.1 (The Minimum-Phase Concept) 

Consider the transfer function of the following systems: 


H i( z ) = 


(z- \){ z ~ \) 
( z ~ 1)0- s) 


H 2 (z) = 


(!- \z){z~ \) 

( z - I)0~ I) 


H 3 (z) = 


(1 - \z){ 1 - \z) 

i z ~ \){ z ~ I) 


Each system has poles inside the unit circle and is thus stable. All systems have the same magnitude. Their 
phase and delay are different, as shown Figure E6.1. 



0 0.25 0.5 



0 0.25 0.5 



0 0.25 0.5 


Digital frequency F 

Figure E6.1 


Digital frequency F 

Response of the systems for Example 6.1 


Digital frequency F 


The phase response confirms that H\(z) is a minimum-phase system with no zeros outside the unit circle, 
H 2 (z) is a mixed-phase system with one zero outside the unit circle, and H 3 (z) is a maximum-phase system 
with all its zeros outside the unit circle. 


6.1.3 Minimum-Phase Filters from the Magnitude Spectrum 

The design of many digital filters is often based on a specified magnitude response \H p (F)\. The phase 
response is then selected to ensure a causal, stable system. The transfer function of such a system is unique 
and may be found by writing its magnitude squared function \Ff p (F)\ 2 as 

\H P (F)\ 2 = H P (F)H P (-F) = H(z)H(l/z)\ z ^ eMj2vF) (6.3) 
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From \H p (F)\ 2 , we can reconstruct Ht(z) = H(z)H(l/z), which displays conjugate reciprocal symmetry. 
For every root r^, there is a root at 1/rj*. We thus select only the roots lying inside the unit circle to extract 
the minimum-phase transfer function H(z). The following example illustrates the process. 


EXAMPLE 6.2 (Finding the Minimum-Phase Filter) 

Find the minimum-phase transfer function H(z) corresponding to \H p iY)\ 2 


5 + 4 cos 
17 + 8 cos f l' 


We use Euler’s relation to give |if p (fl)| 2 
H t (z ) as 


5 + 2e jf2 + 2e- jn 
17 + 4e-?° + 4e~i n ' 


Upon substituting e 


H t {z) = H{z)H{l/z) 


5 + 2 z + 2 /z 
17 + 4z + 4 /z 


2z 2 + 52 + 2 
4 z 2 + 172 + 4 


(2z + 1) (z + 2) 
(4z + l)(z + 4) 


we obtain 


To extract H(z), we pick the roots of Ht(z) that correspond to \z\ < 1. This yields 


H{z) 


(2z + 1) _ (s + 0-5) 
(4z+l) (2 + 0.25) 


We find that |i7(2)| z= i = |i7 p (U)|o=o = 0-6, implying identical dc gains. 


6.1.4 The Frequency Response: A Graphical View 

The frequency response of an LTI system may also be found by evaluating its transfer function H(z) for 
values of 2 = e^ 27rF = e(on the unit circle). The quantity O = 2ttF describes the angular orientation. 
Figure 6.1 shows how the values of 2, U, and F are related on the unit circle. 



Figure 6.1 Relating the variables z, F, and through the unit circle 


REVIEW PANEL 6.3 

The Frequency Response Is the 2- Transform Evaluated on the Unit Circle 

It corresponds to the DTFT: H(F) = H(z)\ z=ej2 ^ F or H(fl) = H(z) | __ eJ . n 
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The factored form or pole-zero plot of H ( 2 ) is quite useful if we want a qualitative picture of its frequency 
response H(F) or H( 12). Consider the stable transfer function H(z) given in factored form by 


H{z) = 


8(*-l) 


(z — 0.6 — j0.6)(z — 0.6 + j'0.6) 

Its frequency response H(Q) and magnitude |if(12)| at O = flo are given by 


80 


>jtt 0 _ 


1) 


H(£Iq) ^ e jQ 0 _ Q.g _ jo.6)(e- ?n ° — 0.6 + j0.6] 


8Ni 

DiD 2 


(6.4) 


(6.5) 


\H(n 0 )\ 


O |Ni| 

L |Di||D 2 | 


PRODUCT OF distances from zeros 

(gam factor)- — ---— 

PRODUCT OF distances from poles 


( 6 . 6 ) 


Analytically, the magnitude |H(fl 0 )l is the ratio of the magnitudes of each term. Graphically, the complex 
terms may be viewed in the 2 -plane as vectors Ni, Di, and D 2 , directed from each pole or zero location 
to the location O = flo on the unit circle corresponding to z = e^ n °. The gain factor times the ratio of the 
vector magnitudes (the product of distances from the zeros divided by the product of distances from the 
poles) yields |ff(f2o)|, the magnitude at = S2 q. The difference in the angles yields the phase at = fio- 
The vectors and the corresponding magnitude spectrum are sketched for several values of fl in Figure 6.2. 



A graphical evaluation can yield exact results but is much more suited to obtaining a qualitative estimate 
of the magnitude response. We observe how the vector ratio N 1 /D 1 D 2 influences the magnitude as O is 
increased from fl = 0 to O = tt. For our example, at fl = 0, the vector Ni is zero, and the magnitude is zero. 
For 0 < fl < 7t/4 (point A), both |Ni| and |D 2 | increase, but |D 1 1 decreases. Overall, the response is small 
but increasing. At Q = 7t/4 , the vector Dj attains its smallest length, and we obtain a peak in the response. 
For j < Q < 7r (points B and C), |N x | and |D]_| are of nearly equal length, while |D 2 | is increasing. The 
magnitude is thus decreasing. The form of this response is typical of a bandpass filter. 

6.1.5 The Rubber Sheet Analogy 

If we imagine the z-plane as a rubber sheet, tacked down at the zeros of H(z) and poked up to an infinite 
height at the pole locations, the curved surface of the rubber sheet approximates the magnitude of H(z) for 
any value of 2 , as illustrated in Figure 6.3. The poles tend to poke up the surface and the zeros try to pull 
it down. The slice around the unit circle (\z\ = 1) approximates the frequency response 


EXAMPLE 6.3 (Filters and Pole-Zero Plots) 

Identify the filter types corresponding to the pole-zero plots of Figure E6.3. 
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(a) Magnitude of H(z) (b) Blowup of magnitude inside and around unit circle 




Filter 1 Filter 2 Filter 3 Filter 4 

Figure E6.3D Pole-zero plots for Example 6.3(d) 


(a) For filter 1, the vector length of the numerator is always unity, but the vector length of the denominator 
keeps increasing as we increase frequency (the points A and B, for example). The magnitude (ratio of 
the numerator and denominator lengths) thus decreases with frequency and corresponds to a lowpass 
filter. 

(b) For filter 2, the vector length of the numerator is always unity, but the vector length of the denominator 
keeps decreasing as we increase the frequency (the points A and B, for example). The magnitude 
increases with frequency and corresponds to a highpass filter. 

(c) For filter 3, the magnitude is zero at Q = 0. As we increase the frequency (the points A and B, for 
example), the ratio of the vector lengths of the numerator and denominator increases, and this also 
corresponds to a highpass filter. 

(d) For filter 4, the magnitude is zero at the zero location fi = fl 0 . At any other frequency (the point B, 
for example), the ratio of the vector lengths of the numerator and denominator are almost equal and 
result in almost constant gain. This describes a bandstop filter. 


6.2 FIR Filters and Linear-Phase 

The DTFT of a filter whose impulse response is symmetric about the origin is purely real or purely imaginary. 
The phase of such a filter is thus piecewise constant. If the symmetric sequence is shifted (to make it causal, 
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for example), its phase is augmented by a linear-phase term and becomes piecewise linear. A filter whose 
impulse response is symmetric about its midpoint is termed a (generalized) linear-phase filter. Linear phase 
is important in filter design because it results in a pure time delay with no amplitude distortion. The 
transfer function of a causal linear-phase filter may be written as H(F ) = A{F)e^ aF (for even symmetry) 
or H(F) = jA( y F)e^ aF = A(F)e^ 27TaF+ ^^ (for odd symmetry), where the real quantity A(F) is the 
amplitude spectrum and a is the (integer or half-integer) index corresponding to the midpoint of its impulse 
response h[n\. The easiest way to obtain this form is to first set up an expression for H(F), then extract the 
factor e- j27rQF from H(F), and finally simplify using Euler’s relation. 


| REVIEW PANEL 6.4 | 

A Linear-Phase Sequence Is Symmetric About Its Midpoint 

If h[n\ is a linear-phase sequence with its midpoint at the (integer or half-integer) index a, then 
H(F) = A(F)ei 2 ' KaF (for even symmetric h[n ]) and H(F) = jA(F)e^ 2 ' KaF (for odd symmetric h[n]). 
To find A(F): Set up H(F), extract e j27raF from H(F), and simplify using Euler’s relation. 


6.2.1 Pole-Zero Patterns of Linear-Phase Filters 

Linear phase plays an important role in the design of digital filters because it results in a constant delay with 
no amplitude distortion. An FIR filter whose impulse response sequence is symmetric about the midpoint 
is endowed with linear phase and constant delay. The pole and zero locations of such a sequence cannot be 
arbitrary. The poles must lie at the origin if the sequence h[n\ is to be of finite length. Sequences that are 
symmetric about the origin also require h[n] = ±/i[—n] and thus H(z) = ±H(l/z). The zeros of a linear- 
phase sequence must occur in reciprocal pairs (and conjugate pairs if complex to ensure real coefficients) 
and exhibit what is called conjugate reciprocal symmetry. This is illustrated in Figure 6.4. 



Conjugate reciprocal symmetry 
for a complex zero for a real zero 


The zeros of a linear-phase sequence 
display conjugate reciprocal symmetry. 


lm 


Figure 6.4 Conjugate reciprocal symmetry 



Each complex zero forms part of a quadruple because it is paired with its conjugate and its reciprocal 
with the following exceptions. Zeros at z = 1 or at z = — 1 can occur singly because they form their own 
reciprocal and their own conjugate. Zeros on the real axis must occur in pairs with their reciprocals (with no 
conjugation required). Zeros on the unit circle (except at z = ±1) must occur in pairs with their conjugates 
(which also form their reciprocals). If there are no zeros at z = 1, a linear-phase sequence is always even 
symmetric about its midpoint. For odd symmetry about the midpoint, there must be an odd number of 
zeros at z = 1. 

The frequency response of a linear-phase filter may be written as H(F) = A{F)e^ aF (for even symme¬ 
try) or H(F) = jA{F)e^ 2 ’ KaF = A(F)e^ 27raF+ ^' > (for odd symmetry), where A(F) is real. 
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REVIEW PANEL 6.5 
Characteristics of a Linear-Phase Filter 

1. The impulse response h{n\ is symmetric about its midpoint. 

2. H(F) = A(F)e^ 27TaF (for even symmetric h[n}) and H(F) = jA{F)e^ 2 ' KaF (for odd symmetric h[n]). 

3. All poles are at 2 = 0 (for finite length). 

4. Zeros occur in conjugate reciprocal quadruples, in general. Zeros on unit circle occur in conjugate pairs. 
Zeros on real axis occur in reciprocal pairs. Zeros at z = 1 or 2 = — 1 can occur singly. 

5. Odd symmetry about midpoint if an odd number of zeros at z = 1 (even symmetry otherwise). 

6. If h,[n] = ±ft[—n], then H(z ) = ±H(4) (symmetry about the origin n = 0). 


EXAMPLE 6.4 (Linear-Phase Filters) 

(a) Does H(z) = 1 + 2 z~ x + 2 z~ 2 + z~ 3 describe a linear-phase filter? 
We express H(z) as a ratio of polynomials in 2 to get 

, z 3 + 2z 2 + 2z+l 


All its poles are at z = 0. Its zeros are at z = — 1 and z = —0.5 ± j'0.866 are consistent with a 
linear-phase filter because the real zero at z = —1 can occur singly and the complex conjugate pair of 
zeros lie on the unit circle. 

Since H(z) ^ ±H(l/z), the impulse response h[n\ cannot be symmetric about the origin n = 0 (even 
though it must be symmetric about its midpoint). 

4 

We could reach the same conclusions by recognizing that h[n) = (l, 2, 2, 1} describes a linear-phase 
sequence with even symmetry about its midpoint n = 1.5. 


(b) Let h[n] = 5[n + 2] + 4.25<5[n] + S[n — 2], Sketch the pole-zero plot of H(z). 

We find H(z) = z 2 +4.25 + z~ 2 . Since h[n] is even symmetric about n = 0 with h[n] = h{—n], we must 
have H{z ) = H(l/z). This is, in fact, the case. 

We express H(z) as a ratio of polynomials in factored form to get 

v , ^ _ z 4 + 4.25z 2 + 1 _ (z + j0.5)(z - j0.5)(z + j2)(z - j2) 

yZ} ~ Z 2 “ 2 2 

The pole-zero plot is shown in Figure E6.4 (left panel). All its poles are at z = 0. The four zeros at 
z = j0.5, z = —j 2, 2 = —j 0.5, and z = j2 display conjugate reciprocal symmetry. 
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Figure E6.4 Pole-zero plots of the filters for Example 6.4(b and c) 


(c) Sketch the pole-zero plot for H(z ) = z 2 + 2.5 z — 2.5 z 1 — z 2 . Is this a linear-phase filter? 

Jf 

We note that H(z) = —H(l/z). This means that h[n] = —h[—n]. In fact, h[n] = {1, 2.5, 0, —2.5, —1}. 
This describes a linear-phase filter. 

With H(z) described as a ratio of polynomials in factored form, we get 

^ _ (z - l)(z + l)(z + 0.5)(z + 2) 
z 2 

The pole-zero plot is shown in Figure E6.4 (right panel). All its poles are at z = 0. There is a pair of 
reciprocal zeros at z — —0.5 and z = —2. The two zeros at 2 = —1 and z = 1 occur singly. 


6.2.2 Types of Linear-Phase Sequences 

Linear-phase sequences fall into four types. A type 1 sequence has even symmetry and odd length. A type 2 
sequence has even symmetry and even length. A type 3 sequence has odd symmetry and odd length. A 
type 4 sequence has odd symmetry and even length. 

To identify the type of sequence from its pole-zero plot, all we need to do is check for the presence of 
zeros at z = ±1 and count their number. A type 2 sequence must have an odd number of zeros at z — —1, a 
type 3 sequence must have an odd number of zeros at z = — 1 and z = 1, and a type 4 sequence must have 
an odd number of zeros at z = 1. The number of other zeros, if present (at z = 1 for type 1 and type 2, 
or z = —1 for type 1 or type 4), must be even. The reason is simple. If we exclude 2 = ±1, the remaining 
zeros occur in pairs or quadruples and always yield a type 1 sequence with odd length and even symmetry. 
Including a zero at z = — 1 increases the length by one without changing the symmetry. Including a zero at 
z = — 1 increases the length by 1 and also changes the symmetry. Only an odd number of zeros at z = 1 
results in an odd symmetric sequence. These ideas are illustrated in Figure 6.5. 


©Ashok Ambardar, September 1, 2003 





224 


Chapter 6 Filter Concepts 


Type 1 


z=-l 



Type 2 


z=— 1 


z = 1 


O Must be an odd number 



Type 3 


z=-l 


z =1 



Type 4 


z=l 


Must be an even number (if present) 



z =1 


All other zeros must show conjugate reciprocal symmetry 
Figure 6.5 Identifying the sequence type from its zeros at 2 = ±1 


REVIEW PANEL 6.6 

How to Identify the Type of a Linear-Phase Sequence 

From the sequence x[n]: Check the length and the symmetry to identify the type. 
From the pole-zero plot: Count the number of zeros at z = ±1. 

Type 1 : Even number of zeros at 2 = —1 (if present) and at z — 1 (if present) 

Type 2 : Odd number of zeros at z = —1 (and even number of zeros at z = 1, if present) 

Type 3: Odd number of zeros at z = 1 and odd number of zeros at z = — 1 

Type 4: Odd number of zeros at z = 1 (and even number of zeros at z = —1, if present) 


EXAMPLE 6.5 (Identifying Linear-Phase Sequences) 

(a) Find all the zero locations of a type 1 sequence, assuming the smallest length, if it is known that there 
is a zero at z = 0.5e :,7r / 3 and a zero at z = 1. 

Due to conjugate reciprocal symmetry, the zero at z = implies the quadruple zeros 

z = 0.5e J7r / 3 z = 0.5e“- J7r / 3 z = 2e- J ' 7r / 3 z = 

For a type 1 sequence, the number of zeros at z = 1 must be even. So, there must be another zero at 
z = 1. Thus, we have a total of six zeros. 


(b) Find all the zero locations of a type 2 sequence, assuming the smallest length, if it is known that there 
is a zero at z = 0.5e- J7r / 3 and a zero at z = 1. 

Due to conjugate reciprocal symmetry, the zero at z = 0.5e J7r / 3 implies the quadruple zeros 

z = 0.5e J7r / 3 z = 0.5e - - J7r / 3 z = 2e^/ 3 z = 2e" J ' 7r / 3 

A type 2 sequence is even symmetric and requires an even number of zeros at z = 1. So, there must 
be a second zero at z = — 1 to give six zeros. But this results in a sequence of odd length. For a type 2 
sequence, the length is even. This requires a zero at z = —1. Thus, we have a total of seven zeros. 


(c) Find the transfer function and impulse response of a causal type 3 linear-phase filter, assuming the 
smallest length and smallest delay, if it is known that there is a zero at z = j and two zeros at z = 1. 

The zero at z = j must be paired with its conjugate (and reciprocal) z = —j. 
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A type 3 sequence requires an odd number of zeros at z = 1 and z = — 1. So, the minimum number of 
zeros required is one zero at z = — 1 and three zeros at z = 1 (with two already present). 

The transfer function has the form 

H(z) = {z + j)(z - j)(z + 1 ){z - l) 3 = z 6 -2z 5 + z 4 -z 2 + 2z-l 

The transfer function of the causal filter with the minimum delay is 

H c (z) = 1 - 2z- 1 + z~ 2 - z~ 4 + 2z~ 5 - h c [n\ = {l, -2, 1, 0, -1, 2, -1} 


6.2.3 Averaging Filters 


As an example of a linear phase filter, we consider a causal fV-point averaging filter whose system equation 
and impulse response are given by 

y[n] = {x[n] + x[n - 1] + ... + x[n - (N - 1)]) h[n) = E 1, 1, ..., 1, 1 } (6.7) 

j\l 1\ v- v -' 

N ones 


Its transfer function then becomes 

H(F) =^E me~ j27rkF 

k =o 


1 

N 


N-l 

Y ( e~ j2nF ) k = 

k =0 


1 

N 


/1 - e ~^ NF \ 
V 1 - e-^ F ) 


We extract the factors e ■ J7rJVF and e from the numerator and denominator respectively to give 


H(F) 

This simplifies to 


_ 1_ / e~jirNF \ / e -jnNF _ e -jirNF \ = ^ ( J 2 NF) \ 


N 


o-jirF 


c-j-rrF _ p-jnF 


N 


j'2sin(7rF) J 


H ( F ) = e -MN-i)F sm(nNF) = c _ MN _ 1)F smc(NF) = e ~MN-V F A ( F ) 


A’sin(7rF) 


sinc(F) 


( 6 . 8 ) 


The term A(F) represents the amplitude and the term describes a phase that varies linearly 

with frequency. The value of H(F) equals unity at F = 0 for any length N. Also, H(F) = 0 when F is a 
multiple of A and there are a total of N zeros in the principal range 0.5 < F < 0.5. At F = 0.5, the value of 
H(F) equals zero if N is even. For odd N, however, the value of H(F) at F = 0.5 equals (—l)( Ar_1 )/ 2 (i.e., 

+1 if A=1 i s even or —1 if i s odd). As |F| increases from 0 to 0.5, the value of | sin(7rF)| increases from 

0 to 1. Consequently, the magnitude spectrum shows a peak of unity at F = 0 and decreasing sidelobes of 
width A on either side of the origin. If we look at the amplitude term A(F) (not its absolute value), we find 
that it is even symmetric about F = 0.5 if N is odd but odd symmetric about F = 0.5 if N is even. 

For an even symmetric sequence vj,i [n] of length M = 2N + 1, centered at the origin, whose coefficients 
are all unity, we have 

w d [n] = {l, 1, ..., 1, 1, 1, 1, 1, ..., 1, 1 } (6.9) 

S_ v / s_ v _/ 

N ones N ones 

Its frequency response may be written as 


W d (F) 


sin(nMF) 
sin(7r F) 


Msinc(MF) 

sinc(F) 


M = 2N + 1 


( 6 . 10 ) 


The quantity Wo ( F) is called the Dirichlet kernel and its properties will be described shortly. 
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6.2.4 Zeros of Averaging Filters 


Consider a causal TV-point averaging filter whose system equation and impulse response are given by 

y[n] = ^(x[n] + x[n - 1] + ... + x[n - (N - 1)]) h[n} = 1, 1, .. ., 1, 1 } (6.11) 

N ones 

Its transfer function H(z) then becomes 


H{z) 


N—l N-l 

jfEMH.-'-s E(0‘ 

k—0 k =0 


ll 

n- z ~ N \ 

i 

\ zN ~ 1 1 

N ' 

vi -z- 1 ) 

~ N 

_z N ~ 1 {z- 1)_ 


The N roots of z N — 1 = 0 lie on the unit circle with an angular spacing of ^ radians starting at = 0 
(corresponding to z = 1). However, the zero at z = 1 is cancelled by the pole at z = 1. So, we have TV — 1 
zeros on the unit circle and N—l poles at the origin (z = 0). The zeros occur in conjugate pairs and if the 
length N is even, there is also a zero at O = n (corresponding to z = —1). 


EXAMPLE 6.6 (Frequency Response and Filter Characteristics) 

(a) Identify the pole and zero locations of a causal 10-point averaging filter. What is the dc gain and high 
frequency gain of this filter? At what frequencies does the gain go to zero? 

The impulse response and transfer function of a 10-point averaging filter is 

Jf 0.1(z 10 — 1) 

h[n\ = {0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1} H(z) = —A-—- 

z y {z — 1) 

There are nine poles at the origin z = 0. There are nine zeros with an angular spacing of ^ rad located 
on the unit circle at z = e ? fe,r / 5 , k= 1,2,..., 9. The dc gain of the filter is \H(0) \ = h[n] \ = 1. The 
high-frequency gain is |R(F)|f=o .5 = | XX - l) n fr[ n ]l = 0. Over the principal range, the gain is zero at 
the frequencies Fk = O.lfc, k = ±1, ±2,..., 5 and the magnitude response shows a central lobe with 
four successively decaying sidelobes on either side. 

(b) Consider the 3-point averaging filter, y[n] = |{a;[n — 1] + x[n] + x[n + 1]}. The filter replaces each 
input value x\n\ by an average of itself and its two neighbors. Its impulse response hi[n] is simply 

-If 

hi[n\ = The frequency response is given by 


l 

Hi(F) = h[n]e~^ Fn 

n=— 1 


1 

3 


e j2nF _|_ e —j2nF 


i[l + 2cos(27rE)] 


The magnitude \H\ (E)| decreases until F = | (when Hi(F) = 0) and then increases to | at F = 5 , 
as shown in Figure E 6 . 6 B. This filter thus does a poor job of smoothing past F = |. 




Figure E6.6B Frequency response of the filters for Example 6.6(b and c) 
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4 

(c) Consider the tapered 3-point moving-average filter h 2 [n] = { 3 , 5 ) 3 }- Its frequency response is given 

by 

H 2 (F) = h[n]e~ j2 « Fn = \e^ F + \ + \e~ j2 * F = \ + \ cos(2 nF) 

n =—1 

Figure E 6 . 6 D shows that \H 2 (F)\ decreases monotonically to zero at F = 0.5 and shows a much 
better smoothing performance. This lowpass filter actually describes a 3-point von Hann (or Hanning) 
smoothing window. 


(d) Consider the differencing filter described by y[n) = x[n] — x[?r — 1]. Its impulse response may be written 
as h[n] = S [n] — 5{n — 1] = {1, —1}. This is actually odd symmetric about its midpoint (n = 0.5). Its 
frequency response (in the fl-form) is given by 

H{Q) = 1 - e jQ = e - jn/2 (e jQ / 2 - e~ jQ/2 ) = 2jsin(0.5fI)e“ J ' n/2 

Its phase is </>(fl) = f — § and shows a linear variation with Q. Its amplitude A(fl) = 2sin(fl/2) 
increases from zero at fl = 0 to two at Q = tt. In other words, the difference operator enhances high 
frequencies and acts as a highpass filter. 


6.2.5 FIR Comb Filters 

A comb filter has a magnitude response that looks much like the rounded teeth of a comb. One such comb 
filter is described by the transfer function 

H(z) = 1-z~ n h[n) = {l, 0, 0, ..., 0, 0, —1} (6.12) 

s -^-' 

N— 1 zeros 

This corresponds to the system difference equation y[n\ = x [rt] — x[n — iV] , and represents a linear-phase 
FIR filter whose impulse response h[n\ (which is odd symmetric about its midpoint) has N + 1 samples with 
h[0] = 1, h[N] = —1, and all other coefficients zero. There is a pole of multiplicity N at the origin, and the 
zeros lie on a unit circle with locations specified by 

Z -N = e -jNQ = 1 = e j2nk n k = 2> ^, Jfe = 0,1, ... ,2V — 1 (6.13) 

The pole-zero pattern and magnitude spectrum of this filter are shown for two values of N in Figure 6.6. 

The zeros of H(z) are uniformly spaced 2n/N radians apart around the unit circle, starting at = 0. 
For even N, there is also a zero at fl = n. Being an FIR filter, it is always stable for any N. Its frequency 
response is given by 

H(F) = 1 - e~ j27TFN (6.14) 

Note that H( 0) always equals 0, but H( 0.5) = 0 for even N and H( 0.5) = 2 for odd N. The frequency 
response H(F ) looks like a comb with N rounded teeth over its principal period —0.5 < F < 0.5. 

A more general form of this comb filter is described by 

H{z) = 1 - az~ N h[n] = {j, 0, 0, 0, 0 , -a} (6.15) 

N—l zeros 
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Magnitude spectrum of H(z) =1 —z N 
|iV= 4 

-nm a. 


-0.5 


0.5 


=> 


Magnitude spectrum of H(z) = 1 -z N 

' YYYYY', 

-0.5 0.5 

Figure 6.6 Pole-zero plot and frequency response of the comb filter H(z) = 1 — z~ N 



It has N poles at the origin, and its zeros are uniformly spaced 2tt/N radians apart around a circle of radius 
R = a l t N , starting at fl = 0. Note that this filter is no longer a linear-phase filter because its impulse 
response is not symmetric about its midpoint. Its frequency response H(F) = 1 — ae~^ 27TFN suggests that 
H( 0) = 1 — a for any N, and H( 0.5) = 1 — a for even N and U(0.5) = 1 + a for odd N. Thus, its magnitude 
varies between 1 — a and 1 + a, as illustrated in Figure 6.7. 


Magnitude spectrum of H(z) = 1 - cxz N Magnitude spectrum of H(z) = 1 - az N 



Another FIR comb filter is described by the transfer function 

H(z) = 1 + z~ N h[n] = {1, 0, 0, ..., 0, 0 , 1} (6.16) 

AT—1 zeros 

This corresponds to the system difference equation y[n) = x [n] + x[n — N], and represents a linear-phase FIR 
filter whose impulse response h[n] (which is even symmetric about its midpoint) has N + 1 samples with 
h[0] = h[N ] = 1, and all other coefficients zero. There is a pole of multiplicity N at the origin, and the zero 
locations are specified by 

z~ N = e~ jNQ = -1 = e j ( 2k+1) * f h = ^ k ^ 1 ' )7T , k = 0,l,...,N-l (6.17) 

The pole-zero pattern and magnitude spectrum of this filter are shown for two values of N in Figure 6.8. 

The zeros of H(z) are uniformly spaced 2ir/N radians apart around the unit circle, starting at 12 = n/N. 
For odd N, there is also a zero at Q = n. Its frequency response is given by 

H(F) = 1 + e~ j2nFN (6.18) 


(c)Ashok Ambardar, September 1, 2003 






6.3 HR Filters 


229 



Note that H( 0) = 2 for any N, but H{ 0.5) = 2 for even N and H( 0.5) = 0 for odd N. 

A more general form of this comb filter is described by 

H{z) = 1 + az~ N h[n] = {l, 0, 0, ..., 0, 0, a} (6.19) 

N—l zeros 


It has N poles at the origin and its zeros are uniformly spaced 27t/N radians apart around a circle of radius 
R = a 1 ' 1 *, starting at fi = n/N. Note that this filter is no longer a linear-phase filter because its impulse 
response is not symmetric about its midpoint. Its frequency response H(F) = 1 + ae~^ FN suggests that 
H( 0) = 1 + a for any N, and H (0.5) = 1 + a for even N and H (0.5) = 1 — a for odd N. Thus, its magnitude 
varies between 1 — a and 1 + a, as illustrated in Figure 6.9. 


Magnitude spectrum of H(z) - 1 + Otz N Magnitude spectrum of H(z) = 1 + az N 


\r\? 

i7V = 4 
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iN= 5 

\ A/ 

A 

,V Y. 

■V v F 

/Vi 

.V V 
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Figure 6.9 Frequency response of the comb filter H(z) = 1 + az 


6.3 HR Filters 

Consider the first-order filter described by 

h lp( f ) = x _ a g-j2 n p hmo) = ^, hmf) U = 0 .5 = rb ;> 0<a<1 (6 - 20) 

The filter Hi 1 p(F) describes a lowpass filter because its dc gain (at F = 0) exceeds the high frequency gain 
(at F = 0.5) and the gain shows a decrease with increasing frequency (from F = 0 to F = 0.5). The filter 
gain and impulse response are shown in Figure 6.10. 
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Figure 6.10 Spectrum and impulse response of first-order lowpass and highpass filters 


We can find the half-power frequency of the lowpass filter from its magnitude squared function: 


\HMF )\ 2 = 


1 — a cos(27 tF) + ja sin(27rF) 1 — 2a cos(2 irF) + a 2 


At the half-power frequency, we have \F[-lp(F)\ 2 = 0.5, and this gives 


= 0.5 or F = J- cos 1 (—z —-V IFI < 0.5 
27r V 2a / 


1 — 2a cos(27tF) + a? 


The phase and group delay of the lowpass filter are given by 


<t>{F) = — tan 


asin(27rF) 

1 — acos(27r F) 


t 9 {F) = -~~ 


1 d<j>(F) acos(27rF) — a 2 


27t dF 1 — 2a cos(27t F) + a 2 


For low frequencies, the phase is nearly linear and the group delay is nearly constant, and they can be 
approximated by 

0(F) ~ — i m«l = |jF|<<1 (6 ' 24) 

1 — a 2n dr 1 — a 

For filters of higher order, we may obtain the group delay by expressing the filter transfer function as the 
sum of first order sections. 

Time Constant and Reverberation Time 

In the time domain, performance measures for a filter are typically based on features of the impulse response 
and step response. The impulse response of the first-order lowpass filter is given by 

h LP [n] = a"it[n] (6.25) 

The time constant of the lowpass filter describes how fast the impulse response decays to a specified fraction 
of its initial value. For a specified fraction of e%, we obtain the effective time constant r/ in samples as 


This value is rounded up to an integer, if necessary. We obtain the commonly measured 1% or 40-dB time 
constant if e = 0.01 (corresponding to an attenuation of 40 dB) and the 0.1% or 60-dB time constant if 
e = 0.001. If the sampling interval t s is known, the time constant r in seconds can be computed from 
t = r]t s . The 60-dB time constant is also called the reverberation time. For higher-order filters whose 
impulse response contains several exponential terms, the effective time constant is dictated by the term with 
the slowest decay (that dominates the response). 
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REVIEW PANEL 6.7 
The Time Constant of a Lowpass Filter 

For y[n] — ay[n — 1] = x[n], the e% time constant is rj = (samples) or r = rit s (seconds) 
For the 1% or 40-dB time constant, e = 0.01 

For the 0.1% or 60-dB time constant (called reverberation time), e = 0.001. 


6.3.1 First-Order Highpass Filters 

Consider the first-order filter described by 

g -p( F ) = 1 +J— ,2,F g »p(°) = 0 < a < 1 (6.27) 

The filter Hhp(F) describes a highpass filter because its high frequency gain (at F = 0.5) exceeds the dc 
gain (at F = 0) and the gain shows an increase with increasing frequency (from F = 0 to F = 0.5). The 
filter gain and impulse response are shown in Figure 6.10. The impulse response of this filter is given by 

hup [n] = (— a) n u[n] = (—1 ) n a n u[n] (6.28) 

It is the alternating sign changes in the samples of /ihp[«] that cause rapid time variations and lead to its 
highpass behavior. Its spectrum Hpp(F) is related to F[pp(F) by F[up{F ) = F[pp(F — 0.5). This means 
that a lowpass cutoff frequency F 0 corresponds to the frequency 0.5 — F 0 of the highpass filter. 

6.3.2 Pole-Zero Placement and Filter Design 

The qualitative effect of poles and zeros on the magnitude response can be used to advantage in understanding 
the pole-zero patterns of real filters. The basic strategy for pole and zero placement is based on mapping 
the passbancl and stopband frequencies on the unit circle and then positioning the poles and zeros based on 
the following reasoning: 

1. Conjugate symmetry: All complex poles and zeros must be paired with their complex conjugates. 

2. Causality: To ensure a causal system, the total number of zeros must be less than or equal to the 
total number of poles. 

3. Origin: Poles or zeros at the origin do not affect the magnitude response. 

4. Stability: For a stable system, the poles must be placed inside (not just on) the unit circle. The pole 
radius is proportional to the gain and inversely proportional to the bandwidth. Poles closer to the unit 
circle produce a large gain over a narrower bandwidth. Clearly, the passband should contain poles near 
the unit circle for large passband gains. 

A rule of thumb: For narrow-band filters with bandwidth AO < 0.2 centered about O 0 , we place 
conjugate poles at z = f?exp(±jO 0 ), where R « 1 — 0.5AO is the pole radius. 

5. Minimum phase: Zeros can be placed anywhere in the z-plane. To ensure minimum phase, the zeros 
must lie within the unit circle. Zeros on the unit circle result in a null in the response. Thus, the 
stopband should contain zeros on or near the unit circle. A good starting choice is to place a zero (on 
the unit circle) in the middle of the stopband or two zeros at the edges of the stopband. 

6 . Transition band: To achieve a steep transition from the stopband to the passband, a good choice is 
to pair each stopband zero with a pole along (or near) the same radial line and close to the unit circle. 

7. Pole-zero interaction: Poles and zeros interact to produce a composite response that may not match 
qualitative predictions. Their placement may have to be changed, or other poles and zeros may have 
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to be added, to tweak the response. Poles closer to the unit circle, or farther away from each other, 
produce small interaction. Poles closer to each other, or farther from the unit circle, produce more 
interaction. The closer we wish to approximate a given response, the more poles and zeros we require, 
and the higher is the filter order. 

Bandstop and bandpass filters with real coefficients must have an order of at least two. Filter design 
using pole-zero placement involves trial and error. Formal design methods are presented in the next chapter. 
It is also possible to identify traditional filter types from their pole-zero patterns. The idea is to use the 
graphical approach to qualitatively observe how the magnitude changes from the lowest frequency F = 0 (or 
O = 0) to the highest frequency F = 0.5 (or O = n) and use this to establish the filter type. 

6.3.3 Second-Order HR Filters 

The general form for the transfer function of a second-order filter is 

z 2 + a 1 z + a2 (z - R z e? a *){z - R z e~^) 
z 2 + Piz + X (z — R p e^ n p)(z ~ R p e~ : > n p) 

This filter can describe a wide variety of responses. One interesting situation occurs when the poles and 
zeros lie along the same angular orientation with O p = O z = O 0 . The gain of such a filter shows a peak or 
a dip around O = O 0 depending on the values of R p and R z . If we assume a causal, minimum-phase filter 
with R p <1 and R z < 1, we observe the following 

(a) If R z > R p , the filter shows a dip in the gain around O = Oq. 

(b) If R z < R p , the filter gain peaks around O = Oo- 

(c) If R z = 0, the filter gain peaks around O = O 0 . 

(d) if R p = 0, we have an FIR filter with a dip or notch around O = Oo- 

If we permit zeros to lie outside the unit circle ( R~ > 1 but R p < 1), we observe the following 

(a) If R z = 1, we have a notch filter with a dc gain of zero at O = Oo- 

(b) If 1 < R z < , there is a dip in the gain around O = Oo. 

(c) If R z = -d-, we have an allpass filter with constant gain. 

(d) If R z > the filter gain peaks around O = Oq. 


EXAMPLE 6.7 (Filters and Pole-Zero Plots) 

Design a bandpass filter with center frequency = 100 Hz, passband 10 Hz, stopband edges at 50 Hz 
and 150 Hz, and sampling frequency 400 Hz. 

We find O 0 = f, AO = |j, O s = [f, ^f], and R = 1 - 0.5AO = 0.9215. 

Passband: Place poles at = Re ±jn ° = 0.9215e ±:,7r / 2 = ±j0.9215. 

Stopband: Place conjugate zeros at Zi^ = e ±J ”'/ 4 and 23,4 = e ±j37r / 4 . 

We then obtain the transfer function as 


H(z) 


(z - e^/ A )(z - e~ j */ 4 ){z - e^^){z - e"-? 37 ^ 4 ) 
(z — j0.9215)(z + j0.9215) 


z 4 + 1 
z 2 + 0.8941 
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Note that this filter is noncausal. To obtain a causal filter H\(z), we could, for example, use double¬ 
poles at each pole location to get 

/ c _ z 4 + 1 _ _ z 4 + 1 _ 

1{z> ~ (z 2 + 0.8941) 2 ~ z 4 + 1.6982z 2 + 0.7210 

The pole-zero pattern and gain of the modified filter Hi(z) are shown in Figure E6.7. 


(a) Pole-zero plot of bandpass filter (b) Magnitude spectrum of bandpass filter 



Re [z] Digital frequency F 

Figure E6.7 Frequency response of the bandpass filter for Example 6.7() 


(a) Design a notch filter with notch frequency 60 Hz, stopband 5 Hz, and sampling frequency 300 Hz. 
We compute fio = yf, AO = and R = 1 — 0.5AO = 0.9476. 

Stopband: We place zeros at the notch frequency to get z 1,2 = e ±jfl ° = e ±j27r ' /5 . 

Passband: We place poles along the orientation of the zeros at pi ,2 = i?e ±jn ° = 0.9476e ±j27r / 5 . 

We then obtain H(z) as 

(z - e^/ b ){z - e- j2 */ 5 ) z 2 - 0.618^ + 1 

^ ““ (z - 0.9476eJ 27r / 5 )O - 0M76e~^/ 5 ) ~ z 2 - 0.5857 + 0.898 

The pole-zero pattern and magnitude spectrum of this filter are shown in Figure E6.7A. 

(a) Pole-zero plot of notch filter (b) Magnitude spectrum of notch filter 



Re [z] Digital frequency F 


Figure E6.7A Frequency response of the bandstop filter for Example 6.7(a) 
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6.3.4 Digital Resonators 

A digital resonator is essentially a narrow-band bandpass filter. One way to realize a second-order resonator 
with a peak at O 0 is to place a pair of poles, with angular orientation ±O 0 (at -2 = i?e jf! ° and z = Re - ^ 0 ), 
and a pair of zeros at z = 0, as shown in Figure 6.11. To ensure stability, we choose the pole radius R to be 
less than (but close to) unity. 




The transfer function of such a digital resonator is 

2 2 2 2 
^ ^ (z — Rei n °)(z — Re~i u °) z 2 — 2zR cos O 0 + R 2 

Its magnitude spectrum |iJ(0)| and realization are also shown in Figure 6.11. 
function \H(Q)\ 2 is given by 


(6.29) 

The magnitude squared 


wm 2 


(et° - Rei n °)(e-? n - Re~i n °) 


This simplifies to 

\H(n )\ 2 = - 1 - 

1 v [1 — 2I?cos(0 — O 0 ) + i? 2 ][l — 2I?cos(0 + Oo) + R 2 ] 

Its peak value A occurs at (or very close to) the resonant frequency, and is given by 


A 2 = \H(n Q )\ 2 


i 

(1 - R) 2 ( 1 - 2R cos 2O 0 + R 2 ) 


(6.30) 

(6.31) 


(6.32) 


The half-power bandwidth Af l is found by locating the frequencies at which |I?(0 )| 2 = 0.5|ff(Oo)| 2 = 0.5A 2 , 
to give 


0.5 


[1 - 2 I?cos (0 - O 0 ) + i? 2 ] [1 - 21 ? cos (O + O 0 ) + R 2 } (1 - I?) 2 (l - 21 ?cos 20 q + R 2 ) 


(6.33) 


Since the half-power frequencies are very close to Oo, we have O + Oo ~ 20o and O — Oo ~ 0.5AO, and the 
above relation simplifies to 

1-21? cos(0.5AO) + i ? 2 = 2(1 - i ?) 2 (6.34) 


This relation between the pole radius R and bandwidth AO can be simplified when the poles are very close 
to the unit circle (with R > 0.9 or so). The values of R and the peak magnitude A are then reasonably well 
approximated by 


i? « 1 — 0.5AO 


A 


1 

(1 — R 2 ) sin O 0 


(6.35) 
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The peak gain can be normalized to unity by dividing the transfer function by A. The impulse response of 
this filter can be found by partial fraction expansion of H (z)/ z, which gives 


H(z) 


K 


K* 


where 


K = 


(z — Re^°)(z — i?e _ f n °) z — Rei n ° z — Re - ^ 0 

Re^ Q ° Re^° gil^o-Tr/z) 


z — Re~^° 


\ z=He3 n 0 Rei n ° — Re~i n ° 2jR, sin H 0 2sinfi 0 

Then, from lookup tables, we obtain 


h[n] = 


R n cos(nfio + Ho — § )u[n] = . ' R n sin[(n + l)fi 0 ]u[n] 

sin 12n 


sin Hi 


(6.36) 

(6.37) 

(6.38) 


To null the response at low and high frequencies (fi = 0 and fi = 7 r), the two zeros in H(z) may be relocated 
from the origin to z = 1 and z = —1, and this leads to the modified transfer function Hi(z): 


Hi(z) = 


z 2 - 1 


z 2 — 2 zR cos H 0 + R 2 


(6.39) 


EXAMPLE 6.8 (Digital Resonator Design) 

We design a digital resonator with a peak gain of unity at 50 Hz, and a 3-dB bandwidth of 6 Hz, assuming 
a sampling frequency of 300 Hz. 

The digital resonant frequency is fi 0 = 2 3 ^ = The 3-dB bandwidth is AH = = 0.047T. We 

compute the pole radius as R = 1 — 0.5AH = 1 — 0.027T = 0.9372. The transfer function of the digital 
resonator is thus 


H(z) 


_ Gz■?_ _ 

(z — Rei n °)(z — Re-i n °) 


Gz 2 Gz 2 

z 2 - 2R cos fi 0 + R 2 _ z 2 - 0.9372z + 0.8783 


For a peak gain of unity, we choose G = = (1 — R 2 ) sinfio = 0.1054. Thus, 


H(z) 


0.1054z 2 

z 2 — 0.9372z + 0.8783 


The magnitude spectrum and passbancl detail of this filter are shown in Figure E 6 . 8 . 


(a) Digital resonator with peak at 50 Hz 



0 50 100 150 

Analog frequency / [Hz] 



40 46.74 50 52.96 60 

Analog frequency / [Hz] 


Figure E6.8 Frequency response of the digital resonator for Example 6.8 


The passband detail reveals that the half-power frequencies are located at 46.74 Hz and 52.96 Hz, a close 
match to the bandwidth requirement (of 6 Hz). 
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6.3.5 Periodic Notch Filters 

A notch filter with notches at periodic intervals may be constructed by placing zeros on the unit circle at 
the notch frequencies, and poles in close proximity along the same angular orientations. One such form is 


H{z) 


N{z) 
N(z/R ) 


1 -z~ N 
1 - ( z/R)~ N 


(6.40) 


Its zeros are uniformly spaced 2n/N radians apart around a unit circle, starting at O = 0, and its poles 
are along the same angular orientations but on a circle of radius R. For stability, we require R < 1 . Of 
course, the closer R is to unity, the sharper are the notches and the more constant is the response at the 
other frequencies. Periodic notch filters are often used to remove unwanted components at the power line 
frequency and its harmonics. 


EXAMPLE 6.9 (Periodic Notch Filter Design) 

We design a notch filter to filter out 60 Hz and its harmonics from a signal sampled at S = 300 Hz. 

The digital frequency corresponding to 60 Hz is F = 60/300 = 0.2 or Cl = 0 . 4 - 7 T. There are thus 
N = 27t/0.47t = 5 notches in the principal range ir < < n (around the unit circle), and the transfer 

function of the notch filter is 


H(z ) 


N(z) 

N(z/R) 


l-z~ 5 z 5 - 1 
1 - ( z/R)~ 5 ~ z 5 -R 5 


Figure E6.9(a) shows the response of this filter for R = 0.9 and R = 0.99. The choice of R, the pole radius, 
is arbitrary (as long as R < 1), but should be close to unity for sharp notches. 


(a) Periodic notch filter: N = 5 R = 0.9, 0.99 (b) Notch filter that also passes dc: R = 0.9, 0.99 




Figure E6.9 Frequency response of the notch filters for Example 6.9 

Comment: This notch filter also removes the dc component. If we want to preserve the dc component, we 
must extract the zero at z = 1 (corresponding to F = 0) from N(z) (by long division), to give 


Ni(z) 


1 -z~ 5 
1-z- 1 


1 + z 1 + z z + z 


-2 


— 3 


„-4 


and use N±(z) to compute the new transfer function Hi(z) = N\{z)/D(z) as 

Ni(z) _ 1 + z- 1 + z~ 2 + z~ 3 + z~ 4 _ z 4 + z 3 + z 2 + z + 1 

l( ' :) ~~ N^z/R) ~ 1 + (z/R)- 1 + ( z/R)- 2 + ( z/R)~ 3 + (z/R)~ 4 ~ + Rz 3 + R 2 z 2 + R 3 z + R 4 

Figure E6.9(b) compares the response of this filter for R = 0.9 and R = 0.99, and reveals that the dc 
component is indeed preserved by this filter. 


©Ashok Ambardar, September 1, 2003 






6.4 Allpass Filters 


237 


6.4 Allpass Filters 


Consider the first-order filter described by 


A + Be^ F 

Ha ( F ) B + Ae j2 nF 




A + B 
B + A 


\H A (0.5)\ 


A-B 
B-A 


= 1 


(6.41) 


Its magnitude at F = 0 and F = 0.5 is equal to unity. In fact, its magnitude is unity for all frequencies, and 
this describes an allpass filter. The fact that its magnitude is constant for all frequencies can be explained 
by a geometric argument, as illustrated in Figure 6.12. 

The numerator and denominator may be regarded as the sum of two vectors of length A and B that 
subtend the same angle f l = 2 ttF. The length of their vector sum is thus equal for any O. An interesting 
characteristic that allows us to readily identify an allpass filter is that its numerator and denominator 
coefficients (associated with powers of e ±: > 2vF or e jT2 ) appear in reversed order. Allpass filters are often used 
to shape the delay characteristics of digital filters. 


REVIEW PANEL 6.8 

Identifying an Allpass Filter by Checking Coefficients 

From transfer function: The coefficients of numerator and denominator appear in reversed order. 
From difference equation: The coefficients of RHS and LHS appear in reversed order. 


H(F) = 


A + Be j2nF 
B + Ae j2nF 


a/o_ + b/q. 
b/q_ + a/q. 


The vectors X and Y are of equal length 
for any value of F (or Q .). 

The magnitude of H(F) is thus unity. 



Figure 6.12 The magnitude spectrum of an allpass filter is constant 


6.4.1 Transfer Function of Allpass Filters 


An allpass filter is characterized by a magnitude response that is constant for all frequencies. For an allpass 
filter with unit gain, \H(F)\ = 1. Its transfer function H(z) also satisfies the relationship 

H{z)H{l/z) = 1 (6.42) 

This implies that each pole of an allpass filter is paired by a conjugate reciprocal zero. As a result, allpass 
filters cannot be minimum-phase. Note that the cascade of allpass filters is also an allpass filter. An allpass 
filter of order N has a numerator and denominator of equal order TV, with coefficients in reversed order: 


. N(z) — C N + Cjy-iZ 1 + • • • + C\z N 1 + z N 
AP[Z> ~ ~D{z) ~ 1 + C lZ - 1 + C 2 z~ 2 + • • • + C n z~ n 


(6.43) 


Note that D(z) = z N N(l/z), and as a result, if the roots of N(z) (the zeros) are at r*,, the roots of D(z) 
(the poles) are at l/r*,, the reciprocal locations. 
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REVIEW PANEL 6.9 

How to Identify an Allpass Filter 

From H(z) = N(z)/D(z ): The coefficients of N(z) and D(z) appear in reversed order. 
From pole-zero plot: Each pole is paired with a conjugate reciprocal zero. 


Consider a stable, first-order allpass filter whose transfer function H{z) and frequency response H{F) 
are described by 

1 -I- cyz 1 -1- 

H{z) =-±— H A (F)= J , \a\ < 1 (6.44) 

z + a a + e JZ7Tr 

If we factor out e^ F from the numerator and denominator of H(F), we obtain the form 

1 + ae j2nF e~ j7rF + ae jnF 


H(F) = 


: + eF* F 


_|_ g jnF ’ 


O < 1 


(6.45) 


The numerator and denominator are complex conjugates. This implies that their magnitudes are equal (an 
allpass characteristic) and that the phase of H(F) equals twice the numerator phase. Now, the numerator 
may be simplified to 


s-j*F . 


+ ae JV = cos(7tF) — j sin(7 tF) + acos(7r F) + jasm(irF) = (1 + a)cos(7rE) — j( 1 — a)sin(7rF) 

The phase <j>(F ) of the allpass filter H(F) equals twice the numerator phase. The phase (j>(F) and phase 
delay t p (F) may then be written as 


4>{F) = —2 tan 


-l 


1 — a 


tan(7rF) 


1 + a 

A low-frequency approximation for the phase delay is given by 

1 — a 


<b(F) 1 

tJF) = = —— tan 

py ’ 2nF t tF 


-l 


1 — a 
1 + a 


tan(7rE) 


t P (F) = 


1 T OL 


(low-frequency approximation) 


The group delay t g (F) of this allpass filter equals 


t g (F) = - 


1 d4(F) 


1 — a 2 


2ir dF 1 + 2acos(27rF) + a 2 
At F = 0 and F = 0.5, the group delay is given by 

1 — a 2 1 — a 1 — a 2 


t 9 ( 0) = 


1 + 2 a + a 2 1 + a 


tg( 0-5) - 


1 + Oi 

1 — 2 a + a 2 1 — a 


(6.46) 


(6.47) 


(6.48) 


(6.49) 


At low frequencies, cos(27rF) ss 1, and the group delay and phase delay are approximately equal. In 
particular, for 0 < a < 1, the delay is less than unity and this allows us to use the allpass filter to generate 
fractional delays by appropriate choice of a. 


6.4.2 Stabilization of Unstable Filters 

Allpass filters are often used to stabilize unstable digital filters, while preserving their magnitude response. 
Consider the unstable filter 


H u {z ) = 


1 + az 1 


I cel < 1 


(6.50) 
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It has a pole at z = — 1/a and is thus unstable. If we cascade H u (z) with a first-order allpass filter whose 
transfer function is H\{z) = (1 + az)/(z + a*), we obtain 

H{z) = H u (z)Hi(z) = (6.51) 

z + or 

The filter H(z) has a pole at z = —a*, and since |a| < 1, it is a stable filter. 

This idea can easily be extended to unstable filters of arbitrary order described as a cascade of a stable 
portion H s {z ) and P unstable first-order sections: 

p 

H u (z) = H s (z) TT —--, \a m \ < 1 (6.52) 

xx . 1 + a m z 

m —1 

To stabilize H u (z), we use an allpass filter Hap(z) that is a cascade of P allpass sections. Its form is 

P 

hap(z)= n 1 + , a z z > \ a ™\< 1 ( 6 - 53 ) 

iii z + a m 

The stabilized filter H(z ) is then described by the cascade H u (z)Hap(z) as 

p 

H(z ) = H u (z)H A p{z) = H s (z ) TT —y—, |a TO | < 1 (6.54) 

J - x 1 z + a* m 

m— 1 

There are two advantages to this method. First, the magnitude response of the original filter is unchanged. 
And second, the order of the new filter is the same as the original. The reason for the inequality \a m \ < 1 
(rather than \a m \ < 1) is that if H u (z ) has a pole on the unit circle, its conjugate reciprocal will also lie on 
the unit circle and no stabilization is possible. 

6.4.3 Minimum-Phase Filters Using Allpass Filters 

Even though allpass filters cannot be minimum-phase, they can be used to convert stable nonminimum-phase 
filters to stable minimum-phase filters. We describe a nonminimum-phase transfer function by a cascade of a 
minimum-phase part Hm (z) (with all poles and zeros inside the unit circle) and a portion with zeros outside 
the unit circle such that 

p 

H NM (z) = H M (z) Y[(z +a M ), \ot m \ > 1 (6.55) 

m—1 

We now seek an unstable allpass filter with 

p 1 * 

Hap(z) = TT , m , \ot m \ > 1 (6.56) 

- LJ - z + a m 

m—1 

The cascade of Hnm(z) and Hap(z) yields a minimum-phase filter with 

p 

H(z) = H nm (z)H ap (z) = H m (z ) [] (1 + O (6-57) 

m= 1 

Once again, H(z) has the same order as the original filter. 
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6.4.4 Concluding Remarks 

We have studied a variety of digital filters in previous sections. As mentioned before, the dc gain (at F = 0 
or 0 = 0) and the high-frequency gain (at F = 0.5 or il = 7r) serve as a useful measures to identify filters. 
The coefficients (and form) of the difference equation, the transfer function and the impulse response reveal 
other interesting and useful characteristics such as linear phase, allpass behaviour and the like. The more 
complex the filter (expression), the less likely it is for us to discern its nature by using only a few simple 
measures. 


EXAMPLE 6.10 (Traditional and Non-Traditional Filters) 

4 

(a) Let h[n] = {—1, —2, 2, 1}. Is this a linear-phase sequence? What type of filter is this? 

The sequence h[n] is linear-phase. It shows odd symmetry about the half-integer index n = 1.5. 

We have H(F) = -1 - 2e~^ F + 2e~ j4nF + e~ j6nF . 

Extract the factor (— e~^ 3nF ) to get H(F) = —e~ : > 3nF [e : ' 3nF + 2e? 7rF — 2e~^ F — e~^ 3vF ]. 

Using Euler’s relation: H(F) = — je -j37rF [2sin(37rF) + 4sin(7rF)] H(0) = 0 14(0.5) = 2 

Amplitude A(F) = 2 sin(37rF) + 4sin(7rF) Phase = —je _j37rF = —37 iF — f. 

Since the magnitude at high frequencies increases, this appears to be a highpass filter. 

Comment: We can also use the central ordinate relations to compute H(0) and 11(0.5) directly from 

3 3 

h[n\. Thus, 11(0) = h \ n \ = 0 and H ( 0-5) = Y (-!)"%] = -l + 2 + 2- l = 2. 

n—0 n —0 


(b) Let h[n] = (—0.8)”u[n]. Identify the filter type and establish whether the impulse response is a linear- 
phase sequence. 


The sequence h[n] is not linear-phase because it shows no symmetry. 
We have H(F ) 


1 + 0.8e _j2irF ' 


We find that 11(0) = 1 ^ g = 0.556 and 11(0.5) = 1+0 g e _^ = = 5. 

Since the magnitude at high frequencies increases, this appears to be a highpass filter. 


(c) Consider a system described by y[n] = ay[n — 1] + x[n ], 0 < a < 1. This is an example of a reverb 
filter whose response equals the input plus a delayed version of the output. Its frequency response may 
be found by taking the DTFT of both sides to give Y(F) = aY(F)e~^ 2 ' KF + X(F). Rearranging this 
equation, we obtain 


H{F) 


Y(F) 

X(F) 


1 

1 - ae~i 2 * F 


Using Euler’s relation, we rewrite this as 


H(F) 


1 

1 - ae-F^ F 


1 

1 — a cos(2irF) — ja sin(27rF) 
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Its magnitude and phase are given by 

= [1 — 2a cos(27r+) + a 2 ] 1 / 2 


<t>{F) = — tan 1 


a sin(27r.F) 

1 — acos(27r.F) 


A typical magnitude and phase plot for this system (for 0 < a < 1) is shown in Figure E6.10C. The 
impulse response of this system equals h[n] = a n u[ri\. 



Figure E6.10C Frequency response of the system for Example 6.10(c) 


(d) Let h[n] = {5, —4, 3, —2}. Identify the filter type and establish whether the impulse response is a 
linear-phase sequence. 

The sequence h[n] is not linear-phase because it shows no symmetry. 

We have H(F) = 5 - Ae~^ F + 3e~ jA * F - 2e~ j6 * F . 

We find H{ 0) = £ h[n} = 2 and H{ 0.5) = £ (-1 ) n h[n] = 5 + 4 + 3 + 2 = 14. 

Since the magnitude at high frequencies increases, this appears to be a highpass filter. 


(e) Let h[n] = (0.8)”w[n]. Identify the filter type, establish whether the impulse response is a linear-phase 
sequence, and find its 60-dB time constant. 


We have H(F) = 


1 


M ^(0) = 


1 


= 5, and 14(0.5) = 


1 


1 


= 0.556 


1 - 0.8e~^ F ' 1-0.8 l-0.8e-^ 1 + 0.6 

The sequence h[n] is not a linear-phase phase because it shows no symmetry. 

Since the magnitude at high frequencies decreases, this appears to be a lowpass filter. The 60-dB time 
constant of this filter is found as 

In e In 0.001 


V = 


= 30.96 


?7 = 31 samples 


In a In 0.8 

For a sampling frequency of S = 100 Hz, this corresponds to r = r/t s = rj/S = 0.31 s. 


(f) Let h[n] = 0.8<5[n] + 0.36(—0.8) n 1 u[n — 1], Identify the filter type and establish whether the impulse 
response is a linear-phase sequence. 


We find H(F) = 0.8 


0.8 


o~j 2ttF 


0.36e- j2 ” F 


1 + 0.8e _j27rF 1 + 0.8e~^ F 


. So, 44(0) = 1 and 4L(0.5) = 


0.8 - 1 

1 - 0.6 


= - 1 . 


The sequence h[n] is not a linear-phase sequence because it shows no symmetry. 

Since the magnitude is identical at low and high frequencies, this could be a bandstop or an allpass 
filter. Since the numerator and denominator coefficients in H(F) appear in reversed order, it is an 
allpass filter. 
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(g) Let h[n] = <5[n] — 8{n — 8]. Identify the filter type and establish whether the impulse response is a 
linear-phase sequence. 

We find H(F) = 1 - e~ jl6lrF . So, 0) = 0 and H( 0.5) = 0. 

This suggests a bandpass filter with a maximum between F = 0 and F = 0.5. On closer examination, 
we find that H(F) = 0 at F = 0, 0.125, 0.25, 0.375, 0.5 when e~ jl6 * F = 1 and \H(F)\ = 2 at four 
frequencies halfway between these. This multi-humped response is sketched in Figure E6.10G and 
describes a comb filter. 

4 

We may write h[n] = {1, 0,0,0,0, 0, 0, 0, — 1}. This is a linear-phase sequence because it shows odd 
symmetry about the index n = 4. 

Comment: Note that the difference equation y[n ] = x[n ] — x[n — 8] is reminiscent of an echo filter. 


Magnitude of comb filter 

mv 


Figure E6.10G Spectrum of the comb filter for Example 6.10(g) 
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CHAPTER 6 PROBLEMS 


6.1 (Frequency Response) For each filter, sketch the magnitude spectrum and identify the filter type. 

(a) h[n] = (5[n] — 5{n — 2] (b) y[n] — 0.25y[n — 1] = x[n] — x[n — 1] 

(c) H(z) = —— (d) y[n] — y[n — 1] + 0.25 y[n — 2] = x[n] + x[n — 1] 

2 — 0.5 

[Hints and Suggestions: To sketch the spectra, first find H(F). To identify the filter type, start by 
computing the gain \H(F)\ at F = 0 and F = O.5.] 

4 

6.2 (Frequency Response) Consider the 3-point averaging filter h[n\ = }{1, 1, 1}. 

(a) Sketch its amplitude spectrum. 

(b) Find its phase delay and group delay. Is this a linear-phase filter? 

(c) Find its response to the input x[n] = cos(wr/3). 

(d) Find its response to the input x[n\ = <5[n]. 

(e) Find its response to the input x[n] = (—1)". 

(f) Find its response to the input x[n] = 3 + 3<5[n] — 6cos(n7r/3). 

[Hints and Suggestions: For (a), use e ^ + e ^ = 2cos 9 to set up H(F) = A(F)e and sketch 
A(F). For (b), use the symmetry in h[n\. For (c), evaluate H(F ) at the frequency of x[n] to find the 
output. For (d), find h[n]. For (e), use (—1)” = cos(n7r). For (f), use superposition.] 

4 

6.3 (Frequency Response) Consider a filter described by h[n] = ^{1, —1, 1}. 

(a) Sketch its amplitude spectrum. 

(b) Find its phase delay and group delay. Is this a linear-phase filter? 

(c) Find its response to the input x[n] = cos(n7r/3). 

(d) Find its response to the input x[n\ = $[n]. 

(e) Find its response to the input x[n] = (—1)". 

(f) Find its response to the input x[n] = 3 + 3<5[n] — 3 cos(2?r7r/3). 

[Hints and Suggestions: For (a), use e? e + e = 2cos0 to set up H(F) = A(F)e^^ and sketch 
A(F). For (b), use the symmetry in h[n}. For (c), evaluate H(F ) at the frequency of x[n] to find the 
output. For (d), find h[n}. For (e), use (—1)” = cos(n7r). For (f), use superposition.] 

4 

6.4 (Frequency Response) Consider the tapered 3-point averaging filter h[n] = {0.5, 1, 0.5}. 

(a) Sketch its amplitude spectrum. 

(b) Find its phase delay and group delay. Is this a linear-phase filter? 

(c) Find its response to the input x[n] = cos(n7r/2). 

(d) Find its response to the input x[n] = 5[n — 1], 

(e) Find its response to the input x[n] = 1 + (— l) n . 

(f) Find its response to the input x[n] = 3 + 2<5[n] — 4cos(n7r/2). 

[Hints and Suggestions: For (a), extract e ? 2,rF in H(F) to set up H(F) = A( y F)e^^ F " > and sketch 
-A(F). For (b), use 0(F). For (c), evaluate H{F) at the frequency of x[n] to find the output. For (d), 
find h[n] and shift. For (e), use (— l) n = cos(n7r) and superposition. For (f), use superposition.] 
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6.5 (Frequency Response) Consider the 2-point differencing filter h[n] = 5[n] — <5[n — 1]. 

(a) Sketch its amplitude spectrum. 

(b) Find its phase and group delay. Is this a linear-phase filter? 

(c) Find its response to the input x[n ] = cos(n7r/2). 

(d) Find its response to the input a;[?r] = it[n]. 

(e) Find its response to the input x[?z] = (—l) n . 

(f) Find its response to the input x[n] = 3 + 2 u[n] — 4cos(?i7r/2). 

[Hints and Suggestions: For (a), extract e J ’ irF in H(F ) to set up 17(F) = A(F)e^^ F " > and sketch 
A(F). For (b), use 0(F). For (c), evaluate i7(F) at the frequency of x[n] to find the output. For (d), 
find y[n ] = u[n} — u[n — 1] and simplify. For (e), use (—l) n = cos(n7r). For (f), use superposition.] 

6.6 (Frequency Response) Consider the 5-point tapered averaging filter h[n) = 4 {l, 2, 3, 2, 1}. 

(a) Sketch its amplitude spectrum. 

(b) Find its phase delay and group delay. Is this a linear-phase filter? 

(c) Find its response to the input x[n] = cos(wr/4). 

(d) Find its response to the input x[n] = <5[n[. 

(e) Find its response to the input x[n] = (—1)". 

(f) Find its response to the input x[n] = 9 + 9<5[n] — 9cos(n7r/4). 

[Hints and Suggestions: For (a), extract e ? 47rF in 17(F) to set up 77(F) = A( y F)e^^ F " > and sketch 
0(F). For (b), use 0(F). For (c), evaluate H(F) at the frequency of x[n] to find the output. For (d), 
find h[n ]. For (e), use (—1)" = cos(n7r). For (f), use superposition.] 

6.7 (Frequency Response) Sketch the gain 117(F) | of the following digital filters and identify the filter 
type. 

(a) y[n] + 0.9 y[n — 1] = x[n ] (b) y[n] — 0.9 y[n — 1] = x[n] 

(c) y[n] + 0.9 y[n — 1] = x[n — 1] (d) y[n] = x[n ] — x[n — 4] 

[Hints and Suggestions: To sketch, start with the gain |FF(F)| at F = 0 and F = 0.5 and add a few 
others such as F = 0.25.] 

6.8 (Frequency Response) Consider a system whose frequency response H(F) in magnitude/phase 
form is H(F) = A{F)e^^ F \ Find the response y[n] of this system for the following inputs. 


(a) x[n] = (5[n[ (b) x[n] = 1 (c) x[n ] = cos(2n7rF 0 ) (d) x[n] = (— 1)" 

[Hints and Suggestions: For (d), note that (— l) n = cos(n7r).[ 


6.9 (Poles and Zeros) Find the transfer function corresponding to each pole-zero pattern shown in 
Figure P6.9 and identify the filter type. 


Im[z ] 


$-X- 

0.7 • 


Filter 1 


Re[z] 


—— 0 - 
- 0.6 


Im[z] 


\Re[z] 


Filter 2 


Im[z] 




0.4 ■ 


Filter 3 


Figure P6.9 Figure for Problem 6.9 
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Im[z ] 

A 

1/50° R' - 1 r | 


X .•■' 
...O 


Filter 4 


(c)Ashok Ambardar, September 1, 2003 








Chapter 6 Problems 


245 


[Hints and Suggestions: To identify the filter type, evaluate \H(z)\ at z = 1 (dc gain) and at z = — 1 
(high frequency gain).] 


6.10 (Inverse Systems) Find the transfer function of the inverse systems for each of the following. Which 
inverse systems are causal? Which inverse systems are stable? 

~ 2 -‘-0.1 „ , , z + 2 


(a) H(z) = 


z 2 - 0.2 


(b) H(z) = 


0.25 


(c) y[n\ — 0.5 y[n — 1] = x[n ] + 2a;[n — 1] (d) h[n] = n(2) n u[n] 

[Hints and Suggestions: For parts (c) and (d), set up H(z) and find Hi(z) = 1/H(z).\ 

6.11 (Minimum-Phase Systems) Classify each causal system as minimum phase, mixed phase, or max¬ 
imum phase. Which of the systems are stable? 

z 2 -1-0 16 z 2 — 4 

< a > = i^25 (b) «W = ?+9 

(c) h[n] = n(2) n u[n] (d) y[n] + y[n — 1] + 0.25 y[n — 2] = x[n\ — 2x[n — 1] 

6.12 (Minimum-Phase Systems) Find the minimum-phase transfer function corresponding to the sys¬ 
tems described by the following: 

(a) H(z)H(l/z) = 1 


(b) H(z)H(l/z) = 


3z 2 — lOz + 3 
3z 2 + 10^ + 3 
5z 2 + 262 + 5 


(c) \H(F)\ 2 = 


2 1.25 + cos(27tF) 


8.5 + 4cos(2ttP) 


[Hints and Suggestions: Pick H(z) to have poles and zeros inside the unit circle. For part (c), set 
cos(2t tF) = 0.5e j2 ’ rF + 0.5 e - j27rF = 0.52 + 0.52- 1 and compare with H(z)H{l/z).] 

6.13 (System Characteristics) Consider the system y[n] — ay[n — 1] = x[n] — /3x[n — 1]. 

(a) For what values of a and /3 will the system be stable? 

(b) For what values of a and f3 will the system be minimum-phase? 

(c) For what values of a and /3 will the system be allpass? 

(d) For what values of a and (3 will the system be linear phase? 


6.14 (Frequency Response) Consider the recursive filter y[n\ + 0.5 y[n — 1] = 0.5cc[?r] + x[n — 1], 

(a) Sketch the filter gain. What type of filter is this? 

(b) Find its phase delay and group delay. Is this a linear-phase filter? 

(c) Find its response to the input x[n] = cos(nn/2). 

(d) Find its response to the input x[n] = <5[n]. 

(e) Find its response to the input x[n] = (—1)". 

(f) Find its response to the input x[n] = 4 + 2S[n] — 4cos(?r7r/2). 

[Hints and Suggestions: For (a), start with \F[(F)\ at F = 0 and F = 0.5 to sketch the gain. For 
(b), use equations for the first-order allpass filter. For (c), evaluate H(F) at the frequency of x[n] to 
find the output. For (d), find h[n]. For (e), use (—1)" = cos(?r7r). For (f), use superposition.] 

4 

6.15 (Linear-Phase Filters) Consider a filter whose impulse response is h[n] = {a, /3, a}. 
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(a) Find its frequency response in amplitude/phase form H(F) = A(F)e and confirm that the 
phase </>(F) varies linearly with F. 

(b) Determine the values of a and /3 if this filter is to completely block a signal at the frequency 
F = while passing a signal at the frequency F = ^ with unit gain. 

(c) What will be the output of the filter in part(b) if the input is x[ri\ = cos(0.5n7r)? 


[Hints and Suggestions: In (a), extract e _ ? 2,rF in H(F) to set up the required form. In (b), set up 
A(F) at the two frequencies and solve for a and f3. In (c), evaluate H(F) at the frequency of the input 
to set up the output.] 


6.16 (First-Order Filters) For each filter, sketch the pole-zero plot, sketch the frequency response to 
establish the filter type, and evaluate the phase delay at low frequencies. Assume that a = 0.5. 
z-a z — 1/a z + l/a 


(a) H{z) = 


(b) H{z) = 


(c) H(z) = 


6.17 (Filter Concepts) Argue for or against the following. Use examples to justify your arguments. 

(a) All the finite poles of an FIR filter must lie at z = 0. 

(b) An FIR filter is always linear phase. 

(c) An FIR filter is always stable. 

(d) A causal HR filter can never display linear phase. 

(e) A linear-phase sequence is always symmetric about is midpoint. 

(f) A minimum-phase filter can never display linear phase. 

(g) An allpass filter can never display linear phase. 

(h) An allpass filter can never be minimum phase. 

(i) The inverse of a minimum-phase filter is also minimum phase. 

(j) The inverse of a causal filter is also causal. 

(k) For a causal minimum-phase filter to have a a causal inverse, the filter must have as many finite 
poles as finite zeros. 


6.18 (Filter Concepts) Let H(z) = -—-———-. What type of filter does H(z) describe? Sketch its 

2 — 0.6 

pole-zero plot. 

(a) What filter does Hi(z) = 1 — H(z) describe? Sketch its pole-zero plot. 

(b) What filter does H 2 (z) = H(—z ) describe? Sketch its pole-zero plot. 

(c) What type of filter does H 3 (z ) = 1 — H(z) — H{—z) describe? Sketch its pole-zero plot. 

(d) Use a combination of the above filters to implement a bandstop filter. 


6.19 (Filter Design by Pole-Zero Placement) Design the following filters by pole-zero placement. 

(a) A bandpass filter with a center frequency of /o = 200 Hz, a 3-dB bandwidth of A/ = 20 Hz, zero 
gain at / = 0 and / = 400 Hz, and a sampling frequency of 800 Hz. 

(b) A notch filter with a notch frequency of 1 kHz, a 3-dB stopband of 10 Hz, and sampling frequency 
8 kHz. 


[Hints and Suggestions: Convert to digital frequencies and put the poles at z = Re ±: > 2nFo where 
R~ 1 — nAF. For (a), put zeros at z = ±1. For (b), put zeros at z = e ±j27ri?0 .] 
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6.20 (Recursive and HR Filters) The terms recursive and HR are not always synonymous. A recursive 
filter could in fact have a finite impulse response and even linear phase. For each of the following 
recursive filters, find the transfer function H(z) and the impulse response h[n\. Which filters (if any) 
describe HR filters? Which filters (if any) are linear phase? 

(a) y[n] — y[n — 1] = x[n\ — x[n — 2] 

(b) y[n] — y[n — 1] = x[n ] — x[n — 1] — 2 x[n — 2] + 2x[n — 3] 

[Hints and Suggestions: Set up H(z) and cancel common factors to generate h[n}.\ 

6.21 (Systems in Cascade and Parallel) Consider the filter realization of Figure P6.21. 

(a) Find its transfer function and impulse response if a ^ (3. Is the overall system FIR or HR? 

(b) Find its transfer function and impulse response if a = (3. Is the overall system FIR or HR? 

(c) Find its transfer function and impulse response if a = (3 = 1. What does the overall system 
represent? 



Figure P6.21 Filter realization for Problem 6.21 


6.22 (Poles and Zeros) It is known that the transfer function H(z) of a filter has two poles at z = 0, two 
zeros at 2 = — 1, and a dc gain of 8. 

(a) Find the filter transfer function H(z) and impulse response h[n\. 

(b) Is this an HR or FIR filter? 

(c) Is this a causal or noncausal filter? 

(d) Is this a linear-phase filter? If so, what is the symmetry in /i[n]? 

(e) Repeat parts (a)-(d) if another zero is added at z = —1. 


6.23 (Frequency Response) Sketch the pole-zero plot and frequency response of the following systems 
and describe the function of each system. 

(a) y[n] = 0.5x[?r] + 0.5 x[n — 1] (b) y[n ] = 0.5a;[n] — 0.5x[n — 1] 


(c) h[n] = |{1, 1 , 1} 
(e) h[n] = {0.5, 1, 0.5} 
(g) H(z )= Z ~°' 5 


(i) H{z) = 


z + 0.5 
Z -b 2 
2 + 0.5 


(d) h[n] = |{1, -1, 1} 

(f) h[n } = {o\ -1, 0.5} 

(h) H(z) = "~ 2 
K J K ’ z + 0.5 

tj( \ ~ 2 + 2z + 3 

(j) H(z) = 


3z 2 + 22+1 

6.24 (Inverse Systems) Consider a system described by h[n] = 0.5<5[n] + 0.5d[?z — 1], 
(a) Sketch the frequency response H(F) of this filter. 


©Ashok Ambardar, September 1, 2003 







248 


Chapter 6 Filter Concepts 


(b) In an effort to recover the input a;[n], it is proposed to cascade this filter with another filter whose 
impulse response is h\[n] = 0.5<5[n] — 0.5<5[n — 1], as shown: 


x n 


h[n] 


h\[n\ 


y[n] 


What is the output of the cascaded filter to the input a;[n]? Sketch the frequency response Hi(F) 
and the frequency response of the cascaded filter. 

(c) What must be the impulse response h 2 [n] of a filter connected in cascade with the original filter 
such that the output of the cascaded filter equals the input x[n], as shown? 


x[n] —> h[n] —> 

(d) Are H 2 (F) and H\(F) related in any way? 


h 2 [n] 


6.25 (Linear Phase and Symmetry) Assume a sequence x[n] with real coefficients with all its poles at 
z = 0. Argue for or against the following statements. You may want to exploit two useful facts. First, 
each pair of terms with reciprocal roots such as (z — a) and (z — 1/a) yields an even symmetric impulse 
response sequence. Second, the convolution of symmetric sequences is also endowed with symmetry. 

(a) If all the zeros lie on the unit circle, x[n\ must be linear phase. 

(b) If x[n\ is linear phase, its zeros must always lie on the unit circle. 

(c) If there are no zeros at z = 1 and x[n\ is linear phase, it is also even symmetric. 

(d) If there is one zero at z = 1 and x [n] is linear phase, it is also odd symmetric. 

(e) If x[n] is even symmetric, there can be no zeros at z = 1. 

(f) If x[n] is odd symmetric, there must be an odd number of zeros at z = 1. 


6.26 (Comb Filters) For each comb filter, identify the pole and zero locations and determine whether it 
is a notch filter or a peaking filter. 


(a) H{z) = 


2 4 - 0.4096 
2 4 - 0.6561 


(b) H{z) = 


- 1 


2 4 - 0.6561 


6.27 (Linear-Phase Filters) Argue for or against the following: 

(a) The cascade connection of two linear-phase filters is also a linear-phase filter. 

(b) The parallel connection of two linear-phase filters is also a linear-phase filter. 


6.28 (Minimum-Phase Filters) Argue for or against the following: 

(a) The cascade connection of two minimum-phase filters is also a minimum-phase filter. 

(b) The parallel connection of two minimum-phase filters is also a minimum-phase filter. 


6.29 (System Analysis) The impulse response of a system is h[n] = 5[n] — aS[n — 1]. Determine a and 
make a sketch of the pole-zero plot for this system to act as 

(a) A lowpass filter. (b) A highpass filter. (c) An allpass filter. 

6.30 (System Analysis) The impulse response of a system is h[n] = a n u[n\, a / 0. Determine a and 
make a sketch of the pole-zero plot for this system to act as 

(a) A stable lowpass filter. (b) A stable highpass filter. (c) An allpass filter. 

6.31 (Allpass Filters) Argue for or against the following: 

(a) The cascade connection of two allpass filters is also an allpass filter. 


©Ashok Ambardar, September 1, 2003 








Chapter 6 Problems 


249 


(b) The parallel connection of two allpass filters is also an allpass filter. 

6.32 (Minimum-Phase Systems) Consider the filter y[n\ = x[n] — 0.65x[n — 1] + 0.1a:[?r — 2]. 

(a) Find its transfer function H(z) and verify that it is minimum phase. 

(b) Find an allpass filter A(z) with the same denominator as H(z). 

(c) Is the cascade H(z)A(z) minimum phase? Is it causal? Is it stable? 


6.33 (Causality, Stability, and Minimum Phase) Consider two causal, stable, minimum-phase digital 
filters whose transfer functions are given by 


F{z) = 


G{z) = 


0 - 0.5 


0-0.5 w 0 + 0.5 

Argue that the following filters are also causal, stable, and minimum phase. 


(a) The inverse filter M(z) = 1/F(z) 

(b) The inverse filter P(z) = 1 /G(z) 

(c) The cascade H(z) = F(z)G(z) 

(d) The inverse of the cascade R(z) = 1/H(z) 

(e) The parallel connection N(z) = F(z) + G(z) 


6.34 


0 + 2 

(Allpass Filters) Consider the filter H(z) = ^ - . The 

(a) Is H{z) an allpass filter? If so, what is its gain? 

(b) What is the response y[n] and the phase delay if Fo = 

(c) What is the response y[n] and the phase delay if F 0 = 

(d) What is the response y[n] and the phase delay if F 0 = 


input to this filter is x[n] 
0 ? 

0.25? 

0.5? 


cos(2n7rFo)- 


6.35 (Allpass Filters) 

scribed by 


Consider two causal, stable, allpass digital filters whose transfer function is cle- 


F(z) 


0.50-1 


0.5 - 0 


G(z) 


0.50+1 
0.5 + 0 


(a) Is the filter L{z) = F -1 ( 0 ) causal? Stable? Allpass? 

(b) Is the filter H(z) = F{z)G{z) causal? Stable? Allpass? 

(c) Is the filter M(z) = H~ 1 {z) causal? Stable? Allpass? 

(d) Is the filter N(z) = +( 0 ) + G(z) causal? Stable? Allpass? 


6.36 (Stabilization by Allpass Filters) The transfer function of a filter is H(z) = 

(a) Is this filter stable? 

(b) What is the transfer function Ai(z) of a first-order allpass filter that can 
What is the transfer function Hg(z) of the stabilized filter? 

(c) If Hs{z) is not minimum phase, pick an allpass filter A'i{z) that converts H$(z) to a minimum- 
phase filter Hm{z). 

(d) Verify that |F(F)| = \H S {F)\= \H M (F)\. 

6.37 (Allpass Filters) Consider a lowpass filter with impulse response h[n\ = (0.5)"u[n]. If its input is 
x[n] = cos(0.5n7r), the output will have the form y[n] = Acos(0.5n7r + 9). 


0 + 3 
0 - 2 ' 

stabilize this filter? 
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(a) Find the values of A and 9. 

(b) What should be the transfer function Hi(z) of a first-order allpass filter that can be cascaded with 
the lowpass filter to correct for the phase distortion and produce the signal z[n] = B cos(0.5nn) 
at its output? 

(c) What should be the gain of the allpass filter in order that z[n\ = x[n]l 


6.38 (Allpass Filters) An unstable digital filter whose transfer function is H(z) 
to be stabilized in a way that does not affect its magnitude spectrum. 


(z + 0.5) (22 + 0.5) . 
( 2 + 5) (22+ 5) 1S 


(a) What must be the transfer function H\(z) of a filter such that the cascaded filter described by 
Hs(z) = H(z)Hi(z) is stable? 

(b) What is the transfer function Hs(z) of the stabilized filter? 

(c) Is Hs(z) causal? Minimum phase? Allpass? 


6.39 (Signal Delay) The delay I? of a discrete-time energy signal x[n] is defined by 


( a ) 

(b) 

(c) 

(d) 

(e) 


kx2 w 

k=— oo 
oo 

fc=-oo 

Verify that the delay of the linear-phase sequence x[n\ = {4,3,2,1, 0,1,2,3,4} is zero. 
Compute the delay of the signal f[n] = x[n — 1]. 

Compute the delay of the signal g[n\ = x[n — 2], 

1 — 0.52 

What is the delay for the impulse response of the filter described by H(z) = --— ? 

2 — 0.5 

1 H - olz 

Compute the delay for the impulse response of the first-order allpass filter H(z) = -. 

2 + a 


[Hints and Suggestions: For part (c), h[n] = —2<5[n] + 1.5(0.5)"w[n]. So, /i[0] = —0.5 and h[n) = 
1.5(0.5)", n > 0. Use this with a table of summations to find the delay.] 


COMPUTATION AND DESIGN 


6.40 (FIR Filter Design) A 22.5-Hz signal is corrupted by 60-Hz hum. It is required to sample this 
signal at 180 Hz and filter out the interference from the the sampled signal. 

(a) Design a minimum-length, linear-phase filter that passes the desired signal with unit gain and 
completely rejects the interference signal. 

(b) Test your design by applying a sampled version of the desired signal, adding 60-Hz interference, 
filtering the noisy signal, and comparing the desired signal and the filtered signal. 

6.41 (Comb Filters) Plot the frequency response of the following filters over 0 < F < 0.5 and describe 
the action of each filter. 

(a) y[n] = x[n\ + ax[n — 4], a = 0.5 

(b) y[n] = x[n\ + ax[n — 4] + a 2 x[n — 8], a = 0.5 

(c) y[n] = x[n\ + ax[n — 4] + a 2 x[n — 8] + a 3 x[n — 12], a = 0.5 


©Ashok Ambardar, September 1, 2003 





Chapter 6 Problems 


251 


(d) y[n] = ay[n — 4] + x[n], a = 0.5 

6.42 (Filter Design) An ECG signal sampled at 300 Hz is contaminated by interference due to 60-Hz 
hum. It is required to design a digital filter to remove the interference and provide a dc gain of unity. 

(a) Design a 3-point FIR filter (using zero placement) that completely blocks the interfering signal. 
Plot its frequency response. Does the filter provide adequate gain at other frequencies in the 
passband? Is this a good design? 

(b) Design an HR filter (using pole-zero placement) that completely blocks the interfering signal. 
Plot its frequency response. Does the filter provide adequate gain at other frequencies in the 
passband? Is this a good design? 

(c) The Matlab based routine ecgsim (on the author’s website) simulates one period of an ECG 
signal. Use the command yecg=ecgsim(3,9) to generate one period (300 samples) of the ECG 
signal. Generate a noisy ECG signal by adding 300 samples of a 60-Hz sinusoid to yecg. Obtain 
filtered signals, using each filter, and compare plots of the filtered signal with the original signal 
yecg. Do the results support your conclusions of parts (a) and (b)? Explain. 


6.43 (Nonrecursive Forms of HR Filters) If we truncate the impulse response of an HR filter to 
N terms, we obtain an FIR filter. The larger the truncation index N, the better the FIR filter 
approximates the underlying HR filter. Consider the HR filter described by y[n] — 0.8 y[n— 1] = x[n\. 

(a) Find its impulse response h[n] and truncate it to N terms to obtain hj^[n\, the impulse response 
of the approximate FIR equivalent. Would you expect the greatest mismatch in the response of 
the two filters to identical inputs to occur for lower or higher values of n? 

(b) Plot the frequency response H(F) and Hj^(F) for N = 3. Plot the poles and zeros of the two 
filters. What differences do you observe? 

(c) Plot the frequency response H(F) and Hn(F) for N = 10. Plot the poles and zeros of the two 
filters. Does the response of Hn(F) show a better match to H(F )? How do the pole-zero plots 
compare? What would you expect to see in the pole-zero plot if you increase N to 50? What 
would you expect to see in the pole-zero plot as N —■> oo? 


Z 1 j Oi 

6.44 (Phase Delay and Group Delay of Allpass Filters) Consider the filter F[(z) = -. 

z + a 

(a) Verify that this is an allpass filter. 

(b) Pick values of a that correspond to a phase delay of t p = 0.1, 0.5, 0.9. For each value of a, plot 
the unwrapped phase, phase delay, and group delay of the filter. 

(c) Over what range of digital frequencies is the phase delay a good match to the value of t p computed 
in part (b)? 

(d) How does the group delay vary with frequency as a is changed? 

(e) For each value of a, compute the minimum and maximum values of the phase delay and the 
group delay and the frequencies at which they occur. 


6.45 (Decoding a Mystery Message) During transmission, a message signal gets contaminated by a 
low-frequency signal and high-frequency noise. The message can be decoded only by displaying it in 
the time domain. The contaminated signal is provided on the author’s website as mysteryl .mat. Load 
this signal into Matlab (using the command load mysteryl). In an effort to decode the message, 
try the following steps and determine what the decoded message says. 

(a) Display the contaminated signal. Can you “read” the message? 

(b) Display the DFT of the signal to identify the range of the message spectrum. 

(c) Design a peaking filter (with unit gain) centered about the message spectrum. 

(d) Filter the contaminated signal and display the filtered signal to decode the message. 
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DIGITAL PROCESSING OF 
ANALOG SIGNALS 


7.0 Scope and Objectives 

This chapter begins with a discussion of sampling and quantization that form the critical link between analog 
and digital signals. It explains how the sampling theorem forms the basis for sampling signals with little 
or no loss of information, and describes schemes for the recovery of analog signals from their samples using 
idealized and practical methods. It introduces the concept of signal quantization and its effects and concludes 
with applications of the digital processing of audio signals. 


7.1 Ideal Sampling 

Ideal sampling describes a sampled signal as a weighted sum of impulses, the weights being equal to the 
values of the analog signal at the impulse locations. An ideally sampled signal Xi(t) may be regarded as the 
product of an analog signal x(t) and a periodic impulse train i(t), as illustrated in Figure 7.1. 



Analog signal 



t s 

Ideally sampled signal 


Sampling function 


Figure 7.1 The ideal sampling operation 


The ideally sampled signal may be mathematically described as 


OO OO OO 

xi(t) = x(t)i(t) = x(t) S(t — nt s ) = x(nt s )S(t — nt s ) = x[n\6(t — nt s ) 

n =—oo n =—oo n =—oo 


(7.1) 


Here, the discrete signal x[n] simply represents the sequence of sample values x(nt s ). Clearly, the sampling 
operation leads to a potential loss of information in the ideally sampled signal Xi(t), when compared with its 
underlying analog counterpart x(t). The smaller the sampling interval t s , the less is this loss of information. 
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Intuitively, there must always be some loss of information, no matter how small an interval we use. Fortu¬ 
nately, our intuition notwithstanding, it is indeed possible to sample signals without any loss of information. 
The catch is that the signal x(t) must be band-limited to some finite frequency B. 


| REVIEW PANEL 7.1 | 

The Ideally Sampled Signal Is a Train of Impulses 

oo oo oo 

xi(t) = x(t) S(t — ntg) = x(nt s )S(t — nt s ) = x[n\S(t — nt s ) 

n =—oo n =—oo n =—oo 

The discrete signal x[n] corresponds to the sequence of the sample values x(nt s ). 


The spectra associated with the various signals in ideal sampling are illustrated in Figure 7.2. The 
impulse train i(t) is a periodic signal with period T = t s = 1/S and Fourier series coefficients I[k] = S. Its 
Fourier transform is a train of impulses (at / = kS) whose strengths equal I[k). 

OO OO 

i(f) = J2 W(/ - kS ) = s Y, s (f - kS ) ( 7 - 2 ) 

k =—oo k =—oo 

The ideally sampled signal x/(t) is the product of x(t) and i(t). Its spectrum Xj(f) is thus described by the 
convolution 

OO OO 

Xi(f) = X(f) * 1(f) = X(f) *S Y, S(f-kS) = S^2 X(f - kS) (7.3) 

k ——oo k =—oo 

The spectrum Xj(f) consists of X(f) and its shifted replicas or images. It is periodic in frequency, with a 
period that equals the sampling rate S. 



Analog signal 
and 

its spectrum 



AC*) 


ki(t) 

Sampling function 
and 

its spectrum 
k«f) 

1(5) ACS) 


Multiply 


xft) = x(t)i(t) 

At 


Ideally sampled signal 
and 

its spectrum 


X,(f) = X(f) *I(f) 



S S 2S - S -B B 

Figure 7.2 Spectra of the signals for ideal sampling 


| REVIEW PANEL 7.2 | 

The Spectrum of an Ideally Sampled Signal Is Periodic with Period S 

OO OO 

Xi(f) = X(f)*s J2 s (f - ks ) = S x U-kS) 

k——oo k =—oo 

The spectrum is the periodic extension of SX(f) with period S. 
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Since the spectral image at the origin extends over (—13,13), and the next image (centered at 5) extends 
over (5 — B, 5 + B), the images will not overlap if 

S — B > B or S>2B (7.4) 

Figure 7.3 illustrates the spectra of an ideally sampled band-limited signal for three choices of the sampling 
frequency 5. As long as the images do not overlap, each period is a replica of the scaled analog signal spectrum 
SX(f). We can thus extract X(f) (and hence x(t)) as the principal period of Xj(f) (between —0.55 and 
0.55) by passing the ideally sampled signal through an ideal lowpass filter with a cutoff frequency of 0.55 
and a gain of 1/S over the frequency range —0.55 < / < 0.55. 




AAA 


Undersampling 
S <2B 


S-B 


7 BS 


Figure 7.3 Spectrum of an ideally sampled signal for three choices of the sampling frequency 


This is the celebrated sampling theorem, which tells us that an analog signal band-limited to a fre¬ 
quency B can be sampled without loss of information if the sampling rate 5 exceeds 2 B (or the sampling 
interval t s is smaller than ^g). The critical sampling rate Sn = 2 B is often called the Nyquist rate or 
Nyquist frequency and the critical sampling interval tfj = 1 /Sn = 1/2 B is called the Nyquist interval. 


| REVIEW PANEL 7.3 | 

Band-Limited Analog Signals Can Be Sampled Without Loss of Information 

If x(t) is band-limited to B, it must be sampled at 5 > 2 B to prevent loss of information. 

The images of X(f) do not overlap in the periodic spectrum Xj(f) of the ideally sampled signal. 
We can recover x(t) exactly from the principal period (—0.55, 0.55), using an ideal lowpass filter. 


If the sampling rate 5 is less than 2 B, the spectral images overlap and the principal period (—0.55, 0.55) 
of Xj(f) is no longer an exact replica of X(f). In this case, we cannot exactly recover x(t), and there is loss 
of information due to undersampling. Undersampling results in spectral overlap. Components of X(f) 
outside the principal range (—0.55, 0.55) fold back into this range (due to the spectral overlap from adjacent 
images). Thus, frequencies higher than 0.55 appear as lower frequencies in the principal period. This is 
aliasing. The frequency 0.55 is also called the folding frequency. 


| REVIEW PANEL 7.4 | 

Undersampling Causes Spectral Overlap, Aliasing, and Irreversible Loss of Information 

If 5 < 2 B, the images of X(f) overlap in the periodic spectrum and we cannot recover x(t). 
Aliasing: A frequency |/o| > 0.55 gets aliased to a lower frequency f a in the range (—0.55, 0.55). 


Sampling is a band-limiting operation in the sense that in practice we typically extract only the principal 
period of the spectrum, which is band-limited to the frequency range (—0.55, 0.55). Thus, the highest 
frequency we can recover or identify is 0.55 and depends only on the sampling rate 5. 
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EXAMPLE 7.1 (The Nyquist Rate) 

Let the signal X\(t) be band-limited to 2 kHz and X 2 (t) be band-limited to 3 kHz. Using properties of the 
Fourier transform, we find the Nyquist rate for the following signals. 

The spectrum of X\{2t) (time compression) stretches to 4 kHz. Thus, Sn = 8 kHz. 

The spectrum of x-i{t — 3) extends to 3 kHz (a time shift changes only the phase). Thus, Sn = 6 kHz. 

The spectrum of x\ (t) + x-i (t) (sum of the spectra) extends to 3 kHz. Thus, Sn = 6 kHz. 

The spectrum of x\{t)x 2 (t) (convolution in the frequency domain) extends to 5 kHz. Thus, Sn = 10 kHz. 
The spectrum of x\ (t) * X 2 (t) (product of the spectra) extends only to 2 kHz. Thus, Sn = 4 kHz. 

The spectrum of ;ri(f)cos(10007rf) (modulation) is stretched by 500 Hz to 2.5 kHz. Thus, Sn = 5 kHz. 


7.1.1 Sampling of Sinusoids and Periodic Signals 

The Nyquist frequency for a sinusoid x(t) = cos(27r/ o t + 0) is Sn = 2/ 0 . The Nyquist interval is tjv = 1/2/o, 
or tN = T /2. This amounts to taking more than two samples per period. If, for example, we acquire just two 
samples per period, starting at a zero crossing, all sample values will be zero, and will yield no information. 

If a signal x(t) = cos(2n f 0 t + 9) is sampled at S, the sampled signal is x[n] = cos(2nnf 0 /S + 9). Its 
spectrum is periodic, with principal period (—0.55, 0.55). If /o < 0.55, there is no aliasing, and the principal 
period shows a pair of impulses at ±/ 0 (with strength 0.5). If / 0 > 0.55, we have aliasing. The components 
at ±/o are aliased to a lower frequency ±/ a in the principal range. To find the aliased frequency |/ 0 |, 
we subtract integer multiples of the sampling frequency from /o until the result f a = fo~ NS lies in the 
principal range (—0.55, 0.55). The spectrum then describes a sampled version of the lower-frequency aliased 
signal x a {t) = cos(2tt f a t + 9). The relation between the aliased frequency, original frequency, and sampling 
frequency is illustrated in Figure 7.4. The aliased frequency always lies in the principal range. 



| REVIEW PANEL 7.5 | 

Finding Aliased Frequencies and Aliased Signals 

The signal x(t) = cos(27r f 0 t + 9) is recovered as x a {t) = cos(27r f a t + 9) if 5 < 2 f 0 . 

fa = fo~ NS, where N is an integer that places f a in the principal period (—0.55, 0.55). 


A periodic signal x p (t) with period T can be described by a sum of sinusoids at the fundamental frequency 
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/o = 1/T and its harmonics kfo■ In general, such a signal may not be band-limited and cannot be sampled 
without aliasing for any choice of sampling rate. 


EXAMPLE 7.2 (Aliasing and Sampled Sinusoids) 

(a) Consider the sinusoid x(t) = A cos(27r/ 0 t + 6) with f 0 = 100 Hz. 

1. If x(t) is sampled at 5 = 300 Hz, no aliasing occurs, since 5 > 2/ 0 . 

2. If x(t) is sampled at 5 = 80 Hz, we obtain f a = f 0 — S = 20 Hz, The sampled signal describes a 
sampled version of the aliased signal Acos[2-7r(20)f + 9\. 

3. If 5 = 60 Hz, we obtain fo — 25 = —20 Hz. The aliased sinusoid corresponds to 
Acos[27t(— 20)t + 6\ = Acos[27r(20)f — 9\. Note the phase reversal. 


(b) Let x p (t) = 8cos(27 rt) + 6cos(87r t) + 4cos(227rf) + 6sin(327rf) + cos(587rf) + sin(667rt). 

If it is sampled at 5 = 10 Hz, the last four terms will be aliased. The reconstruction of the sampled 
signal will describe an analog signal whose first two terms are identical to x p (t), but whose other 
components are at the aliased frequencies. The following table shows what to expect. 


fo (Hz) 

Aliasing? 

Aliased Frequency f a 

Analog Equivalent 

1 

No (f 0 < 0.5 S) 

No aliasing 

8 cos(27rf) 

4 

No (f 0 < 0.5 S) 

No aliasing 

6 cos(87 rt) 

11 

Yes 

11-5=1 

4cos(27rf) 

16 

Yes 

16 - 25 = -4 

6sin(—87rt) = — 6sin(8 

29 

Yes 

29-35 = -1 

cos(—27rf) = cos(27rf) 

33 

Yes 

33 - 35 = 3 

sin(67rf) 


The reconstructed signal corresponds to xs(t) = 13 cos(27rf) + sin(67rf) + 6 cos(87rf) — 6 sin(87rf), which 
cannot be distinguished from x p (t) at the sampling instants t = nt s , where t s = 0.1 s. To avoid aliasing 
and recover x p (t), we must choose S > 2 B = 66 Hz. 


(c) Suppose we sample a sinusoid x(t) at 30 Hz and obtain the periodic spectrum of the sampled signal, 
as shown in Figure E7.2C. Is it possible to uniquely identify x(t)? 



Figure E7.2C Spectrum of sampled sinusoid for Example 7.2(c) 

We can certainly identify the period as 30 Hz, and thus S = 30 Hz. But we cannot uniquely identify 
x(t) because it could be a sinusoid at 10 Hz (with no aliasing) or a sinusoid at 20 Hz, 50 Hz, 80 Hz, etc. 
(all aliased to 10 Hz). However, the analog signal y(t) reconstructed from the samples will describe a 
10-Hz sinusoid because reconstruction extracts only the principal period, ( — 15, 15) Hz, of the periodic 
spectrum. In the absence of any a priori information, we almost invariably use the principal period as 
a means to uniquely identify the underlying signal from its periodic spectrum, for better or worse. 
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7.1.2 Application Example: The Sampling Oscilloscope 

The sampling theorem tells us that in order to sample an analog signal without aliasing and loss of informa¬ 
tion, we must sample above the Nyquist rate. However, some applications depend on the very act of aliasing 
for their success. One example is the sampling oscilloscope. A conventional oscilloscope cannot directly 
display a waveform whose bandwidth exceeds the bandwidth of the oscilloscope. However, if the signal is 
periodic (or can be repeated periodically) and band-limited, a new, time-expanded waveform can be built 
up and displayed by sampling the periodic signal at successively later instants in successive periods. The 
idea is illustrated in Figure 7.5 for a periodic signal x(t) = 1 + cos(27r/o/) with fundamental frequency /o- 

x(t) = 1 +cos(2jt/ 0 f) y(t) = 1 + cos[2jc (f Q -S)t 



•X(f) 

x s (f) 1 

Y(f) 

1 


1 

l 

ki0.5) 

f A | A 

A A A / A 

f / 

-fo 

fo _ /ot y 

\ t/o / 

V 


-S s-f 0 

fo-S S S-f 0 

fo-S 


Figure 7.5 The principle of the sampling oscilloscope 


If the sampling rate is chosen to be less than / 0 (i.e., S < fo), the spectral component at fo will alias 
to the smaller frequency f a = fo — S. To ensure no phase reversal, the aliased frequency must be less than 
0.5S'. Subsequent recovery by a lowpass filter with a cutoff frequency of fc = will yield the signal 
y(t) = 1 + cos[27t(/ 0 — S)t\, which represents a time-stretched version of x(t). With y(t) = x(t/a), the 
stretching factor a and highest sampling rate S are related by 

fo fo c (a-l)/o t ^ 

a = ~r = —c s = —7— ( 7 - 5 ) 

Ja JO b & 

The closer S is to the fundamental frequency /o, the larger is the stretching factor and the more slowed 
down the signal y(t). This reconstructed signal y{t) is what is displayed on the oscilloscope (with appropriate 
scale factors to reflect the parameters of the original signal). For a given stretching factor a, the sampling 
rate may also be reduced to S m = S/m (where m is an integer) as long as it exceeds 2/ 0 /a- and ensures that 
the aliased component appears at fo/a with no phase reversal. The only disadvantage of choosing smaller 
sampling rates (corresponding to fewer than one sample per period) is that we must wait much longer in 
order to acquire enough samples to build up a one-period display. 

More generally, if a periodic signal x(t) with a fundamental frequency of fo is band-limited to the TVth 
harmonic frequency / max = -/V/o, the stretching factor and sampling rate are still governed by the same 
equations. As before, the sampling rate may also be reduced to S m = S/m (where m is an integer) as long 
as it exceeds 2 / max /a and ensures that each harmonic kfo is aliased to kfo/a with no phase reversal. 


EXAMPLE 7.3 (Sampling Oscilloscope Concepts) 

(a) We wish to see a 100-MHz sinusoid slowed down by a factor of 50. The highest sampling rate we can 
choose is 

S = ~ ^ = 98 MHz 

a 

This causes the slowed down (aliased) signal to appear at 2 MHz. We may even choose a lower 
sampling rate (as long as it exceeds 4 MHz) such as S 2 = S/2 = 49 MHz or S 7 = S/7 = 14 MHz 
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or S 20 = 5/20 = 4.9 MHz and the original signal will still alias to 2 MHz with no phase reversal. 
However, if we choose S 28 = 5/28 = 3.5 MHz (which is less than 4 MHz), the aliased signal will appear 
at —1.5 MHz and no longer reflect the correct stretching factor. 


(b) We wish to slow down a signal made up of components at 100-MHz and 400 MHz by a factor of 50. 
The fundamental frequency is /o = 100 MHz and the highest sampling rate we can choose is 

S = ^ ~ ^ = 98 MHz 
a 

The frequency of 100 MHz slows down to 2 MHz and the highest frequency of 400 MHz slows down 
(aliases) to 8 MHz. We may also choose a lower sampling rate (as long as it exceeds 16 MHz) such as 
S 2 = S/2 = 49 MHz or 5 3 = 5/5 = 19.6 MHz and the frequencies will will still alias to 4 MHz and 
8 Mhz with no phase reversal. However, if we choose 57 = 5/7 = 14 MHz (which is less than 16 MHz), 
the 400 MHz component will alias to —6 MHz and no longer reflect the correct stretching factor. 


7.1.3 Sampling of Bandpass Signals 

The spectrum of baseband signals includes the origin whereas the spectrum of bandpass signals occupies 
a range of frequencies between Jl and fn, where //. is greater than zero. The quantity B = fn — J'l is a 
measure of the bandwidth of the bandpass signal. Even though a Nyquist rate of 2/# can be used to recover 
such signals, we can often get by with a lower sampling rate. This is especially useful for narrow-band signals 
(or modulated signals) centered about a very high frequency. To retain all the information in a bandpass 
signal, we actually need a sampling rate that aliases the entire spectrum to a lower frequency range without 
overlap. The smallest such frequency is 5 = 2/h/N, where N = int (fn/B) is the integer part of fn/B. 
Other choices are also possible and result in the following bounds on the sampling frequency 5 

2 ^ L <S<^±k=l,2,...,N (7.6) 

The integer k can range from 1 to N. The value k = N yields the smallest sampling rate 5 = 2 fjj /N, and 
k = 1 yields the highest sampling rate corresponding to the Nyquist rate 5 > 2 fn- If k is even, the spectrum 
of the sampled signal shows reversal in the baseband. 


EXAMPLE 7.4 (Sampling of Bandpass Signals) 

Consider a bandpass signal xcif) with //, = 4 kHz and fn — 6 kHz. Then B = fn — /l = 2 kHz and we 
compute N = int(//r/-B) = 3. Possible choices for the sampling rate 5 (in kHz) are given by 

T- S ~k^i' k= 1, 2, 3 

For k = 3, we have 5 = 4 kHz. This represents the smallest sampling rate. 

For k = 2, we have 6 kHz < 5 < 8 kHz. Since k is even, the spectrum shows reversal in the baseband. 

For k = 1, we have 5 > 12 kHz and this corresponds to exceeding the Nyquist rate. 

Figure E7.4 shows the spectra of the analog signal and its sampled versions for 5 = 4, 7, 14 kHz. 
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Spectrum of bandpass signal 

K I A 


/(kHz) 


Spectrum o^signal sampled at 4 kHz 

"/(kHz) 




4 6 

Spectrum of signal sampled at 7 kHz 


2 4 6 8 

Spectrum of signal sampled at 14 kHz 


K A 


_£( kHz) 


K I A 


/(kHz) 


1 3 4 6 4 6 8 10 

Figure E7.4 Spectra of bandpass signal and its sampled versions for Example 7.4 


7.1.4 Natural Sampling 

Conceptually, natural sampling, is equivalent to passing the signal x(t ) through a switch that opens and 
closes every t s seconds. The action of the switch can be modeled as a periodic pulse train p(t) of unit height, 
with period t s and pulse width td■ The sampled signal Xat(/) equals x{t) for the td seconds that the switch 
remains closed and is zero when the switch is open, as illustrated in Figure 7.6. 



Analog signal 


Multiplier 
X 



>p(t) 

JL 

1111. 


■%(/) = x(t)p(t) 


Naturally sampled sign; 


Sampling function 


Figure 7.6 Natural sampling 


The naturally sampled signal is described by Xjsr(t) = x{t)p{t). The Fourier transform P{f ) is a train of 
impulses whose strengths P[k\ equal the Fourier series coefficients of p(t): 


OO 

P{f)= E Pmf-kS) (7.7) 

k =—oo 

The spectrum X N (f) of the sampled signal Xs(t) = x(t)p(t) is described by the convolution 

OO OO 

X N {f) = X{f)*P{f) = X{f)* E P[k]6tf-kS)= E P[k]X(f-kS) (7.8) 

k =—oo k =—oo 


The various spectra for natural sampling are illustrated in Figure 7.7. Again, X^{f) is a superposition of 
X(f) and its amplitude-scaled (by P[k\), shifted replicas. Since the P[k ] decay as 1/k, the spectral images 
get smaller in height as we move away from the origin. In other words, Xiy(f) does not describe a periodic 
spectrum. However, if there is no spectral overlap, the image centered at the origin equals P[0]X(f), and 
X(f) can still be recovered by passing the sampled signal through an ideal lowpass filter with a cutoff 
frequency of 0.5S' and a gain of 1/P[0], —0.5S' < / < 0.5S, where P[0] is the clc offset in p(t). In theory, 
natural sampling can be performed by any periodic signal with a nonzero clc offset. 
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Figure 7.7 Spectra of the signals for natural sampling 


25 



REVIEW PANEL 7.6 


Naturally Sampling Uses a Periodic Pulse Train p(t) 

OO 

x N {t) = x(t)p(t) X N (f) = P[k]X(f-kS) 

k =—oo 

P[k\ = - f p{t)e~ j2nkSt dt 
ts Jt s 


7.1.5 Zero-Order-Hold Sampling 

In practice, analog signals are sampled using zero-order-hold (ZOH) devices that hold a sample value 
constant until the next sample is acquired. This is also called flat-top sampling. This operation is 
equivalent to ideal sampling followed by a system whose impulse response h(t) = rect[(t — 0.5t s )/t s ] is a 
pulse of unit height and duration t s (to stretch the incoming impulses). This is illustrated in Figure 7.8. 



Sanrolina function 


“h(t) 

'LL 


Hold circuit 



ZOH sampled signal 


Figure 7.8 Zero-order-hold sampling 


The sampled signal x ZOH (t) can be regarded as the convolution of h(t) and an ideally sampled signal: 


•t'ZOH (t) = h(t) *Xl(t) 


h(t) * 


OO 

x(nt s )S(t — nt s ) 

n——oo 


(7.9) 
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The transfer function H{f) of the zero-order-hold circuit is the sine function 

H{f) = t. sine Uts)e~ inft - = ^ sincQe"^/ 5 (7.10) 

Since the spectrum of the ideally sampled signal is 5 X) X(f — kS ), the spectrum of the zero-order-hold 
sampled signal x ZOH (t) is given by the product 

P OO 

Izoh (/) = sinc(|)e-^^ s £ X(f - kS ) (7.11) 

k=— oo 

This spectrum is illustrated in Figure 7.9. The term sine (//-S') attenuates the spectral images X(f — kS ) 
and causes sine distortion. The higher the sampling rate 5, the less is the distortion in the spectral image 
X(f) centered at the origin. 




Figure 7.9 Spectrum of a zero-order-hold sampled signal 


REVIEW PANEL 7.7 


The Zero-Order-Hold (ZOH) Sampled Signal Is a Staircase Approximation of x{t) 
ZOH sampling: Ideal sampling followed by a hold system with h(t) = rect[(f — 0.5t s )/t s ] 


^ZOH (t) — * 


x(nt s )S(t — nt s ) 


n =—oo 


IzOH(/) = 


P OO 

sinc(l) £ x (f~ ks ) 


k =—c 




An ideal lowpass filter with unity gain over —0.55 < / < 0.55 recovers the distorted signal 

X(f)=X(f) sinc(£)e-^/ s , -0.55 </< 0.55 (7.12) 

To recover X(f) with no amplitude distortion, we must use a compensating filter that negates the effects 
of the sine distortion by providing a concave-shaped magnitude spectrum corresponding to the reciprocal of 
the sine function over the principal period |/| < 0.55, as shown in Figure 7.10. 

The magnitude spectrum of the compensating filter is given by 

|H - (/)l = sdujsy W s °- 5S < 713 > 
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Figure 7.10 Spectrum of a filter that compensates for sine distortion 


EXAMPLE 7.5 (Sampling Operations) 

(a) The signal x(t) = sinc(4000f) is sampled at a sampling frequency S = 5 kHz. The Fourier transform of 
x(t) = sinc(4000t) is X(f) = (l/4000)rect(//4000) (a rectangular pulse over ±2 kHz). The signal x(t) 
is band-limited to fs = 2 kHz. The spectrum of the ideally sampled signal is periodic with replication 
every 5 kHz, and may be written as 

W)= £ SX(f-kS) = 1.25 £ rec(t^) 


(b) The magnitude spectrum of the zero-order-hold sampled signal is a version of the ideally sampled signal 
distorted (multiplied) by sinc(//S), and described by 


n OO OO / 

X ZOH (f) = sinc(-) ^ X(f — kS) = 1.25sinc(0.0002/) ^ red/ 

k ——oo 1 —— x 


k——oo 


f — 5000A: \ 
4000 ) 


(c) The spectrum of the naturally sampled signal, assuming a rectangular sampling pulse train p{t) with 
unit height, and a duty ratio of 0.5, is given by 

*„(/)= £ PWU-W-X £ mrec(^) 

k ——oo k——oo x ' 

Here, P[k] are the Fourier series coefficients ofp(f), with P[k] = 0.5sinc(0.5fc). 


7.2 Sampling, Interpolation, and Signal Recovery 

For a sampled sequence obtained from an analog signal x(t), an important aspect is the recovery of the 
original signal from its samples. This requires “filling in” the missing details, or interpolating between the 
sampled values. The nature of the interpolation that recovers x(t ) may be discerned by considering the 
sampling operation in the time domain. Of the three sampling operations considered earlier, only ideal (or 
impulse) sampling leads to a truly discrete signal x[n] whose samples equal the strengths of the impulses 
x(nt s )6(t — nt s ) at the sampling instants nt s . This is the only case we pursue. 
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7.2.1 Ideal Recovery and the Sine Interpolating Function 

The ideally sampled signal xi(t) is the product of the impulse train i(t) = J2 S(t — nt a ) and the analog signal 
x(t) and may be written as 

oo oo oo 

xi(t) = x(t) S(t — ntg) = x(nt s )6(t — nt s ) = x[n]S(t — nt s ) (7-14) 

n ——oo n =—oo n =—oo 


The discrete signal x[n] is just the sequence of samples x(nt s ). We can recover x(t) by passing xi(t) through 
an ideal lowpass filter with a gain of t s and a cutoff frequency of OAS 1 . The frequency-domain and time- 
domain equivalents are illustrated in Figure 7.11. 



Figure 7.11 Recovery of an analog signal from its sampled version 


The impulse response of the ideal lowpass filter is a sine function given by h{t) = sinc(t/t s ). The recovered 
signal x(t) may therefore be described as the convolution 


x(t) = Xi(t ) * h(t) 


OO 

x(nt s )6(t — nt s ) 

n——oo 


oo 

* h(t) = ^ x[n\h(t — nt s ) 

n =—oo 


(7.15) 


This describes the superposition of shifted versions of h(t) weighted by the sample values x[n\. Substituting 
for h(t), we obtain the following result that allows us to recover x(t) exactly from its samples x[n] as a sum 
of scaled shifted versions of sine functions: 

°o 

x{t) = a;[n]sincf-—(7.16) 

' 1 ,s 

n =—oo 

The signal x(t) equals the superposition of shifted versions of h(t) weighted by the sample values x[n]. At 
each sampling instant, we replace the sample value x[n] by a sine function whose peak value equals x[n] and 
whose zero crossings occur at all the other sampling instants. The sum of these sine functions yields the 
analog signal x(t), as illustrated in Figure 7.12. 

If we use a lowpass filter whose impulse response is hf(t) = 2t s B sinc(2i?t) (i.e., whose cutoff frequency 
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Signal reconstruction from x[n\ = [1, 2, 3, 4] by sine interpolation 



Figure 7.12 Ideal recovery of an analog signal by sine interpolation 


is B instead of 0.55), the recovered signal x(t) may be described by the convolution 

OO 

x(t) =x I (t)*h f (t) = E 2 t s B x[n]sinc[2B(t — nt s )] (7-17) 

71— — 00 

This general result is valid for any oversampled signal with t s < 0.5/ B and reduces to the previously obtained 
result if the sampling rate 5 equals the Nyquist rate (i.e., 5 = 2 B). 

Sine interpolation is unrealistic from a practical viewpoint. The infinite extent of the sine means that it 
cannot be implemented on-line, and perfect reconstruction requires all its past and future values. We could 
truncate it on either side after its magnitude becomes small enough. But, unfortunately, it decays very 
slowly and must be preserved for a fairly large duration (covering many past and future sampling instants) 
in order to provide a reasonably accurate reconstruction. Since the sine function is also smoothly varying, it 
cannot properly reconstruct a discontinuous signal at the discontinuities even with a large number of values. 
Sine interpolation is also referred to as band-limited interpolation and forms the yardstick by which all 
other schemes are measured in their ability to reconstruct band-limited signals. 


7.2.2 Interpolating Functions 


Since the sine interpolating function is a poor choice in practice, we must look to other interpolating signals. 
If an analog signal x(t) is to be recovered from its sampled version x[n] using an interpolating function hi(t), 
what must we require of h t {t) to obtain a good approximation to x{t)l At the very least, the interpolated 
approximation x{t) should match x{t) at the sampling instants nt s . This suggests that hi(t) should equal 
zero at all sampling instants, except the origin where it must equal unity, such that 


hi(t) 


1 , t = 0 

0, t = nt s , (n = ±1, ±2, ±3,...) 


(7.18) 


In addition, we also require ft.,(f) to be absolutely integrable to ensure that it stays finite between the 
sampling instants. The interpolated signal x(t) is simply the convolution of hi{i) with the ideally sampled 
signal Xi{i), or a summation of shifted versions of the interpolating function 


OO 

x{t) = hi(t) -kxi{i) = x[n]hi(t — nt s ) 

n =—oo 


(7.19) 
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At each instant nt s , we erect the interpolating function h{(t — nt s ), scale it by x[n], and sum to obtain 
x(t). At a sampling instant t = kt s , the interpolating function hi(kt s — nt s ) equals zero, unless n = k 
when it equals unity. As a result, x(t) exactly equals x(t) at each sampling instant. At all other times, the 
interpolated signal x(t) is only an approximation to the actual signal x{t). 

7 . 2.3 Interpolation in Practice 

The nature of hi(t) dictates the nature of the interpolating system both in terms of its causality, stability, 
and physical realizability. It also determines how good the reconstructed approximation is. There is no 
“best” interpolating signal. Some are better in terms of their accuracy, others are better in terms of their 
cost effectiveness, still others are better in terms of their numerical implementation. 

Step Interpolation 

Step interpolation is illustrated in Figure 7.13 and uses a rectangular interpolating function of width t s , 
given by h(t) = rect[(< — 0.5 t s )/t s ], to produce a stepwise or staircase approximation to x(t). Even though 
it appears crude, it is quite useful in practice. 



Figure 7.13 Step interpolation 


At any time between two sampling instants, the reconstructed signal equals the previously sampled value 
and does not depend on any future values. This is useful for on-line or real-time processing where the output 
is produced at the same rate as the incoming data. Step interpolation results in exact reconstruction of 
signals that are piecewise constant. 

A system that performs step interpolation is just a zero-order-hold. A practical digital-to-analog converter 
(DAC) for sampled signals uses a zero-order-hold for a staircase approximation (step interpolation) followed 
by a lowpass (anti-imaging) filter (for smoothing the steps). 

Linear Interpolation 

Linear interpolation is illustrated in Figure 7.14 and uses the interpolating function h{t) = tri (t/t s ) to 
produce a linear approximation to x{t) between the sample values. 




Figure 7.14 Linear interpolation 

At any instant t between adjacent sampling instants nt s and (n + l)f s , the reconstructed signal equals 
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x[n] plus an increment that depends on the slope of the line joining x[n] and x[n + 1]. We have 
_. , . . . . x\n + ll — x\n] , 

x(t) = x[n] + (t — nt a ) -, nt s < t < (n+l)t s (7.20) 

t s 

This operation requires one future value of the input and cannot actually be implemented on-line. It can, 
however, be realized with a delay of one sampling interval t s , which is tolerable in many situations. Systems 
performing linear interpolation are also called first-order-hold systems. They yield exact reconstructions 
of piecewise linear signals. 

Raised Cosine Interpolating Function 

The sine interpolating function forms the basis for several others described by the generic relation 

h(t) = g(t)smc(t/t s ), where 5 ( 0 ) = 1 (7.21) 

One of the more commonly used of these is the raised cosine interpolating function described by 

MO = 1 COS( ( ^^ ) ) 2 sinc (t/ts), 0 < R < 1 (7.22) 

Here, R is called the roll-off factor. Like the sinc interpolating function, h TC (t) equals 1 at t = 0 and 0 
at the other sampling instants. It exhibits faster decaying oscillations on either side of the origin for R > 0 
as compared to the sinc function. This faster decay results in improved reconstruction if the samples are 
not acquired at exactly the sampling instants (in the presence of jitter, that is). It also allows fewer past 
and future values to be used in the reconstruction as compared with the sinc interpolating function. The 
terminology raised cosine is actually based on the shape of its spectrum. For R = 0, the raised cosine 
interpolating function reduces to the sinc interpolating function. 


EXAMPLE 7.6 (Signal Reconstruction from Samples) 

Let x[n] = {—1,2,3,2}, t s = 1. What is the value of the reconstructed signal x(t) at 2.5 s that results from 
step, linear, sinc, and raised cosine (with R = 0.5) interpolation? 

(a) For step interpolation, the signal value at t = 2.5 s is simply the value at t = 2. Thus, x(2.5) = 3. 


(b) If we use linear interpolation, the signal value at i = 2.5 s is simply the average of the values at t = 2 
and t = 3. Thus, i(2.5) = 0.5(3 + 2) = 2.5. 


(c) If we use sinc interpolation, we obtain 

3 

x(t) = ^ cc[/c]sinc(t — kt s ) = —sinc (t) + 2 sinc(t — 1) + 3 sinc(f — 2) + 2 sinc(t — 3) 

fc =0 


So, £(2.5) = 0.1273 - 0.4244 + 1.9099 + 2.5465 = 4.1592. 
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(d) If we use raised cosine interpolation (with R = 0.5), we obtain 


k =0 ' ' 


We use this equation to compute 


Z,(+\ _ sinc(t) cos(0.57rt) , 0 sinc(t— 1) cos[0.57r(£— 1)] , 0 sinc(£—2) cos[0.57r(£—2)] , A sinc(£—3) cos[0.57r(£—3)] 

X \ c ) ~ X—t 2 h 1 1—(t—1)2 r- 3 i-(t-2) 2 h 4 1—(t—3)2 


~{t~ 2)2 


l-(i-3)2 


Thus, £(2.5) = 0.0171 - 0.2401 + 1.8006 + 2.4008 = 3.9785. 


7.3 Sampling Rate Conversion 

In practice, different parts of a DSP system are often designed to operate at different sampling rates because 
of the advantages it offers. Sampling rate conversion can be performed directly on an already sampled signal, 
without having to re-sample the original analog signal, and requires concepts based on interpolation and 
decimation. Figure 7.15 shows the spectrum of sampled signals obtained by sampling a band-limited analog 
signal x(t) whose spectrum is X(f) at a sampling rate S, a higher rate NS, and a lower rate S/M. All three 
rates exceed the Nyquist rate to prevent aliasing. 


X(f) 



B 




Sampling rate = NS 
NSX(f) 


f 


Sampling rate = 
SX(f)/M 

"7 


/ \ A 


B NS B 

Figure 7.15 Spectra of a signal sampled at three sampling rates 


S/M 


The spectrum of the oversampled signal shows a gain of N but covers a smaller fraction of the principal 
period. The spectrum of a signal sampled at the lower rate S/M is a stretched version with a gain of 1/M. 
In terms of the digital frequency F, the period of all three sampled versions is unity. One period of the 
spectrum of the signal sampled at S Hz extends to B/S, whereas the spectrum of the same signal sampled at 
NS Hz extends only to B/NS Hz, and the spectrum of the same signal sampled at S/M Hz extends farther 
out to BM/S Hz. After an analog signal is first sampled, all subsequent sampling rate changes are typically 
made by manipulating the signal samples (and not resampling the analog signal). The key to the process 
lies in interpolation and decimation. 

7.3.1 Zero Interpolation and Spectrum Compression 

A property of the DTFT that forms the basis for signal interpolation and sampling rate conversion is that M- 
fold zero interpolation of a discrete-time signal x[n\ leads to an M -fold spectrum compression and replication, 
as illustrated in Figure 7.16. 
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y[n] Fourfold zero interpolation 



1234 



F 


Figure 7.16 Zero interpolation of a signal leads to spectrum compression 


The zero-interpolated signal y[n] = x[n/N ] is nonzero only if n = kN , k = 0, ±1,±2,... (i.e., if n is an 
integer multiple of N). The DTFT Y P (F) of y[n] = y[kN] may be expressed as 

oo oo oo 

Y p (F) = J2 y[n]e~ j2 ™ F = J2 y[kN}e~^ kNF = ^ x[k]e~^ kNF = X p (NF) (7.23) 

n=— oo k=— oo k=— oo 


This describes Y P (F ) as a scaled (compressed) version of the periodic spectrum X p (F) and leads to AT-fold 
spectrum replication. This is exactly analogous to the Fourier series result for analog periodic signals where 
spectrum zero interpolation produces replication (compression) of the periodic signal. The spectrum of the 
interpolated signal y[n] shows N compressed images per period, centered at F = f / T . The image centered at 
F = 0 occupies the frequency range |F| < 0.5/At. 

Similarly, the spectrum of a decimated signal y[n] = x[nM} is a stretched version of the original spectrum 
and is described by 


Y P (F) = 



(7.24) 


The factor 1/M ensures that we satisfy Parseval’s relation. If the spectrum of the original signal x[n\ extends 
to |F| < 0.5/M in the central period, the spectrum of the decimated signal extends over |.F| < 0.5 and there 
is no aliasing or overlap between the spectral images. As a result, the central image represents a stretched 
version of the spectrum of the original signal x [n]. Otherwise, there is aliasing and the stretched images 
overlap. Because the images are added where overlap exists, the central image gets distorted and no longer 
represents a stretched version of the spectrum of the original signal. This is a situation that is best avoided. 


REVIEW PANEL 7.8 
The Spectra of Zero-Interpolated and Decimated Signals 

Zero interpolation by N gives N compressed images per period centered at F = //. 

In decimation by M, the gain is reduced by M and images are stretched by M (and added if they overlap). 


EXAMPLE 7.7 (Zero Interpolation and Spectrum Replication) 

The spectrum of a signal x[n] is X(F) = 2tri(5F). Sketch X(F) and the spectra of the following signals 
and explain how they are related to X(F). 
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1. The zero interpolated signal y[n] = x[n/ 2] 

2. The decimated signal d[n] = x[2n ] 

3. The signal g[n\ that equals x[n ] for even n, and 0 for odd n 
Refer to Figure E7.7 for the spectra. 

(a) The spectrum Y(F) is a compressed version of X(F) with Y(F) = X(2F). 

(b) The spectrum D(F) = 0.5A(0.5F) is a stretched version of X(F) with a gain factor of 0.5. 

(c) The signal g[n\ may be expressed as g[n\ = 0.5(a;[n] + (—l)"a;[n]). Its spectrum (or DTFT) is 
described by G(F) = 0.5[X(F) + X(F — 0.5)]. We may also obtain g[n\ by first decimating x[n] by 2 
(to get d[n\), and then zero-interpolating d[?r] by 2. 



0.4 0.6 1 0.2 0.3 0.5 0.7 0.8 1 

Figure E7.7 The spectra of the signals for Example 7.7 


7.3.2 Sampling Rate Increase 

A sampling rate increase by an integer factor N involves zero interpolation and digital lowpass filtering, 
as shown in Figure 7.17. The signals and their spectra at various points in the system are illustrated in 
Figure 7.18 for N = 2. 


x[n] 

Up-sample (zero-interpolate) 

w[ n ] 

Anti-imaging digital filter 

0 5 

s\ 


NS\ 

Gain = N F r = — 

c N 


Figure 7.17 Sampling rate increase by an integer factor 


An up-sampler inserts N — 1 zeros between signal samples and results in an TV-fold zero-interpolated 
signal corresponding to the higher sampling rate NS. Zero interpolation by N results in TV-fold replication 
of the spectrum whose central image over |A| < 0.5/TV corresponds to the spectrum of the oversampled signal 
(except for a gain of TV). The spurious images are removed by passing the zero-interpolated signal through 
a lowpass filter with a gain of TV and a cutoff frequency of Fq = 0.5/TV to obtain the required oversampled 
signal. If the original samples were acquired at a rate that exceeds the Nyquist rate, the cutoff frequency of 
the digital lowpass filter can be made smaller than 0.5/TV. This process yields exact results as long as the 
underlying analog signal has been sampled above the Nyquist rate and the filtering operation is assumed 
ideal. 
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x[n]‘ 

i Input signal 




(X 

2 [ 1 

n 


t 


t 




X(F) 


Spectrum of input 



w[n]* 


Zero-interpolated signal 


(IV =2) 





W(F) 


Spectrum of up-sampled signal 


(IV =2) 





Figure 7.18 Spectra of signals when increasing the sampling rate 


| REVIEW PANEL 7.9 | 

To Increase the Sampling Rate by N, Up-Sample by N and Lowpass Filter 

Up-sampling compresses (and replicates) spectrum. The LPF ( Fq = ^7, gain = N ) removes the images. 


EXAMPLE 7.8 (Up-Sampling and Filtering) 

In the system of Figure E7.8, the spectrum of the input signal is given by X(F) = tri(2F), the up-sampling 
is by a factor of 2, and the impulse response of the digital filter is given by h[n] = 0.25 sinc(0.25n). Sketch 
X(F), W(F), H(F), and Y(F) over -0.5 < F < 0.5. 


x[n] 

Up-sample (zero-interpolate) 

w[n] 

Digital filter 

y[n] 

X(F) 


W(F) 

H(F) 

Y(F) 


Figure E7.8 The system for Example 7.8 


The various spectra are shown in Figure E7.8A. 


The spectrum X(F) is a triangular pulse of unit width. Zero interpolation by two results in the compressed 
spectrum W(F). Now, h[n\ = 2 Fq sinc(2?iFc') corresponds to an ideal filter with a cutoff frequency of Fq- 
Thus, Fc = 0.125, and the filter passes only the frequency range |F| < 0.125. 



Figure E7.8A The spectra at various points for the system of Example 7.8 
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7.3.3 Sampling Rate Reduction 

A reduction in the sampling rate by an integer factor M involves digital lowpass filtering and decimation, 
as shown in Figure 7.19. The signals and their spectra at various points in the system for M = 2 are shown 
in Figure 7.20. 


x[ n ] 

Anti-aliasing digital filter 
„ . , „ 0.5 

Gain =1 F„ = — 

v[n] 

Down-sample (keep every Mth sample) 

d[n] 



Ml 


S\ 

C M 

s! 

S/M 


Figure 7.19 Sampling rate reduction by an integer factor 


First, the sampled signal is passed through a lowpass filter (with unit gain) to ensure that it is band- 
limited to \F\ < 0.5 /M in the principal period and to prevent aliasing during the decimation stage. It is then 
decimated by a clown-sampler that retains every Mth sample. The spectrum of the decimated signal is a 
stretched version that extends to |F| < 0.5 in the principal period. Note that the spectrum of the decimated 
signal has a gain of 1/M as required, and it is for this reason that we use a lowpass filter with unit gain. 
This process yields exact results as long as the underlying analog signal has been sampled at a rate that is 
M times the Nyquist rate (or higher) and the filtering operation is ideal. 
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Spectrum of decimated signal ( M=2 ) 
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Figure 7.20 The spectra of various signals during sampling rate reduction 


REVIEW PANEL 7.10 

To Decrease Sampling Rate by M : Unity-Gain LPF (Fc = yy) and Down-Sampling by M 

The LPF (Fc = jj) band-limits the input. Down-sampling stretches the spectrum. 


Fractional sampling-rate changes by a factor M/N can be implemented by cascading a system that 
increases the sampling rate by N (interpolation) and a system that reduces sampling rate by M (decimation). 
In fact, we can replace the two lowpass filters that are required in the cascade (both of which operate at the 
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sampling rate NS) by a single lowpass filter whose gain is 1 /N and whose cutoff frequency is the smaller of 
0.5/M and 0.5 /N, as shown in Figure 7.21. 


x[n] 

Up-sample 

w[n] 

Digital lowpass filter 

/„ _ 

0.5\ 
M j 

v[n] 

Down-sample 

ybd 

st 

4 

ivy! 

Gain = N F r = Min (%■ * 

c \N 

mt 

Ml 

S(N/M) 



/ 



Figure 7.21 Illustrating fractional sampling-rate change 


REVIEW PANEL 7.11 

How to Implement a Fractional Sampling-Rate Change by M/N 

Interpolate by N =>■ lowpass filter (using Fq = max °jv/ n) anc ^ & a ^ n = jy) decimate by M. 


7.4 Quantization 

The importance of digital signals stems from the proliferation of high-speed digital computers for signal 
processing. Due to the finite memory limitations of such machines, we can process only finite data sequences. 
We must not only sample an analog signal in time but also quantize (round or truncate) the signal amplitudes 
to a finite set of values. Since quantization affects only the signal amplitude, both analog and discrete-time 
signals can be quantized. Quantized discrete-time signals are called digital signals. 

Each quantized sample is represented as a group (word) of zeros and ones (bits) that can be processed 
digitally. The finer the quantization, the longer the word. Like sampling, improper quantization leads to loss 
of information. But unlike sampling, no matter how fine the quantization, its effects are irreversible, since 
word lengths must necessarily be finite. The systematic treatment of quantization theory is very difficult 
because finite word lengths appear as nonlinear effects. Quantization always introduces some noise, whose 
effects can be described only in statistical terms, and is usually considered only in the final stages of any 
design, and many of its effects (such as overflow and limit cycles) are beyond the realm of this text. 

7.4.1 Uniform Quantizers 

Quantizers are devices that operate on a signal to produce a finite number of amplitude levels or quantization 
levels. It is common practice to use uniform quantizers with equal quantization levels. 

The number of levels L in most quantizers used in an analog-to-digital converter (ADC) is invariably a 
power of 2. If L = 2 B , each of the L levels is coded to a binary number, and each signal value is represented 
in binary form as a B-bit word corresponding to its quantized value. A Tbit quantizer is thus capable of 2 4 
(or 16) levels and a 12-bit quantizer yields 2 12 (or 4096) levels. 

A signal may be quantized by rounding to the nearest quantization level, by truncation to a level 
smaller than the next higher one, or by sign-magnitude truncation, which is rather like truncating 
absolute values and then using the appropriate sign. These operations are illustrated in Figure 7.22. 

For a quantizer with a full-scale amplitude of ±X, input values outside the range |A| will get clipped 
and result in overflow. The observed value may be set to the full-scale value (saturation) or zero (zeroing), 
leading to the overflow characteristics shown in Figure 7.23. 

The quantized signal value is usually represented as a group (word) with a specified number of bits 
called the word length. Several number representations are in use and illustrated in Table 7.1 for B = 3. 
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Some forms of number representation are better suited to some combinations of quantization and overflow 
characteristics and, in practice, certain combinations are preferred. In any case, the finite length of binary 
words leads to undesirable, and often irreversible, effects collectively known as finite-word-length effects. 


Rounding Truncation Sign-magnitude truncation 




Actual value 



Actual value 


Figure 7.23 Two overflow characteristics 


Table 7.1 Various Number Representations for B = 3 Bits 


Decimal 

Value 

Sign and 
Magnitude 

One’s 

Complement 

Two’s 

Complement 

Offset 

Binary 

+4 




111 

+3 

Oil 

011 

011 

110 

+2 

010 

010 

010 

101 

+1 

001 

001 

001 

000 

+0 

000 

000 

000 


-0 

100 

111 


Oil 

-1 

101 

110 

111 

010 

-2 

110 

101 

110 

001 

-3 

111 

100 

101 

000 

-4 



100 



7.4.2 Quantization Error and Quantization Noise 

The quantization error, naturally enough, depends on the number of levels. If the quantized signal 
corresponding to a discrete signal x[n] is denoted by xq[u\, the quantization error e[n\ equals 

e[n] = x[n] — (7-25) 
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It is customary to define the quantization signal-to-noise ratio (SNRq) as the ratio of the power Pg in 
the signal and the power Pn in the error e[n] (or noise). This is usually measured in decibels, and we get 

p s = n ^ Pn = N ^ e ^ SNRg(dB) = 10 log = 10 log (7-26) 

n- 0 n=0 N 2^i l 1 

The effect of quantization errors due to rounding or truncation is quite difficult to quantify analytically 
unless statistical estimates are used. The dynamic range or full-scale range of a signal x(t) is defined as 
its maximum variation D = cc max — x m i n . If x(t) is sampled and quantized to L levels using a quantizer with 
a full-scale range of D, the quantization step size, or resolution, A, is defined as 

A = D/L (7.27) 

This step size also corresponds to the least significant bit (LSB). The dynamic range of a quantizer is often 
expressed in decibels. For a 16-bit quantizer, the dynamic range is 20 log 2 16 « 96 dB. 

For quantization by rounding, the maximum value of the quantization error must lie between —A/2 and 
A/2. If L is large, the error is equally likely to take on any value between —A/2 and A/2 and is thus 
uniformly distributed. Its probability density function /(e) has the form shown in Figure 7.24. 


l/A 

‘/(e) 





8 


-A/2 A/2 


Figure 7.24 Probability density function of a signal quantized by rounding 


The noise power Pjv equals its variance er 2 (the second central moment), and is given by 

r A/2 


P N = a 2 = 


i r 


i r A/2 2 , a 2 

e 2 de = -— 


A/2 


12 


The quantity er = A/-\/l2 defines the rms quantization error. With A = D/L, we compute 


10 log Pat = 10 log 


D 2 

12L 2 


= 20 log D - 20 log L- 10.8 


(7.28) 


(7.29) 


A statistical estimate of the SNR in decibels, denoted by SNIig, is thus provided by 

SNRg(dB) = 10log P s - 10log P N = 10log P s + 10.8 + 20log L- 20log D (7.30) 

For a B-bit quantizer with L = 2 B levels (and A = D/2 B ), we obtain 

SNRg(dB) = 10 log P s + 10.8 + 6B - 20 log D (7.31) 

This result suggests a 6-dB improvement in the SNR for each additional bit. It also suggests a reduction in 
the SNR if the dynamic range D is chosen to exceed the signal limits. In practice, signal levels do not often 
reach the extreme limits of their dynamic range. This allows us to increase the SNR by choosing a smaller 
dynamic range D for the quantizer but at the expense of some distortion (at very high signal levels). 
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EXAMPLE 7.9 (Quantization Effects) 

(a) A sampled signal that varies between —2 V and 2 V is quantized using B bits. What value of B will 
ensure an rms quantization error of less than 5 mV? 

The full-scale range is D = 4 V. The rms error is given by a = A/\/T2. With A = D/2 B , we obtain 

2 b = = 230.94 B = log, 230.94 = 7.85 

cr\/T 2 0.005VT2 

Rounding up this result, we get B = 8 bits. 


(b) Consider the ramp x{t) = 2t over (0,1). For a sampling interval of 0.1 s, and L = 4, we obtain the 
sampled signal, quantized (by rounding) signal, and error signal as 

x[n] = {0,0.2,0.4,0.6,0.8,1.0,1.2,1.4,1.6,1.8,2.0} 
x Q [n] = {0,0.0,0.5,0.5,1.0,1.0,1.0,1.5,1.5,2.0,2.0} 
e[n] = {0,0.2,-0.1,0.1,-0.2,0.0,0.2,-0.1,0.1,-0.2,0.0} 


We can now compute the SNR in several ways. 

Pc \ 15 4 

1. SNRq = 10 log = 10 log 2 = 10 log — = 18.9 dB 

P N °- 2 

2. We could also use SNRq = lOlogPs + 10.8 + 20 log L — 20 log D. With D = 2 and N = 11, 


SNR, s . 


10 log 


1 

N 


N-l 


x2 M 

n =0 


10.8 + 20 log 4 - 20 log 2 = 18.7 dB 


3. If x(t) forms one period of a periodic signal with T = 1, we can also find P 5 and SNRg as 
P s = ^ J x 2 (t)dt= ^ SNR 5 = 101 og(|) + 10 log 12 + 20 log 4 — 20 log 2 = 18.062 dB 


Why the differences between the various results? Because SNR 5 is a statistical estimate. The larger 
the number of samples N, the less SNRq and SNR ,5 differ. For N = 500, for example, we find that 
SNRq = 18.0751 dB and SNRg = 18.0748 dB are very close indeed. 


(c) Consider the sinusoid x(t) = A cos(2nft). The power in x(t) is Ps = 0.5A 2 . The dynamic range of 
x(t) is D = 2A (the peak-to-peak value). For a B-bit quantizer, we obtain the widely used result 

SNR, s = lOlogPs + 10.8 + 6 B - 201ogL> = 6 B + 1.76 dB 
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7.4.3 Quantization and Oversampling 

Even though sampling and quantization are independent operations, it turns out that oversampling allows 
us to use quantizers with fewer bits per sample. The idea is that the loss of accuracy in the sample values 
(by using fewer bits) is offset by the larger number of samples (by using a higher sampling rate). This is a 
consequence of how the quantization noise power is distributed. 

The quantized signal is XQ[n\ = x[n] + e[n]. The quantization error e[n] may be assumed to be a white- 
noise sequence that is uncorrelated with the signal x[n], with a uniform probability density over the range 
(—0.5A, 0.5A). The variance (average power) of e[n] is a 2 = A 2 /12. The spectrum of e[n] is flat over the 
principal range (0.5S 1 , 0.5.S), and the average power cr 2 is equally distributed over this range. The power 
spectral density of e[n] is thus P ee (/) = cr 2 /S. If a signal is oversampled at the rate NS, the noise spectrum 
is spread over a wider frequency range (—0.5 NS, 0.5NS). The power spectral density is thus N times less 
for the same total quantization noise power. In fact, the in-band quantization noise in the region of interest, 
(—0.5S, 0.55 1 ), is also decreased by a factor of N. This is illustrated in Figure 7.25. 


a 2 /NS ^ 

a 2 /S 





J_ 



1 / 


-NSI 2 -SI 2 SI 2 NSI 2 




Figure 7.25 Quantization noise spectrum of an oversampled signal 


If we were to keep the in-band noise power the same as before, we can recover the signal using fewer bits. 
For such a quantizer with B 2 = (B — A B) bits per sample, an average power of cr 2 , and a sampling rate of 
S 2 = NS Hz, we obtain the same in-band quantization noise power when its power spectral density is also 
cr 2 /5, as illustrated in Figure 7.25. Thus, 


S 



a 2 = 


a 


2 

2 


N 


Assuming the same full-scale range D for each quantizer, we obtain 


D 2 _ D 2 

(12)2 2B “ (127V)2 2 ( B-AB ) 


N = 2 2AB AB = 0.51og 2 N 


(7.32) 


(7.33) 


This result suggests that we gain 0.5 bits for every doubling of the sampling rate. For example, N = 4 
(four-times oversampling) leads to a gain of 1 bit. In practice, a better trade-off between bits and samples 
is provided by quantizers that not only use oversampling but also shape the noise spectrum (using filters) 
to further reduce the in-band noise, as shown in Figure 7.25. A typical noise shape is the sine function, and 
a pth-order noise-shaping filter has the form ITns(/) = |2 sin(7r//AS')| p , —0.5NS < / < 0.5NS, where N is 
the oversampling factor. Equating the filtered in-band noise power to cr 2 , we obtain 

^ = (3YslZ' HmU) ' 2df (7 - 34) 


If N is large, H^sif) ~ | (2irf/NS)\ p over the much smaller in-band range (—0.55, 0.55), and we get 


cr 


2 




/2ttA 2P 

\NS) 


df 


T 2 7T 2 P 


(2 p + 1) A2P+ 1 


(7.35) 
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Simplification, with a f/cr 2 = 2 2AB , gives 


AB = (p + 0.5)log 2 N - 0-5 log 2 ( 2 ^ 1 ) (7-36) 

This shows that noise shaping (or error-spectrum shaping ) results in a savings of p log 2 N additional bits. 
With p = 1 and N = 4, for example, A B « 2 bits. This means that we can make do with a, (B — 2)-bit DAC 
during reconstruction if we use noise shaping with four-times oversampling. In practical implementation, 
noise shaping is achieved by using an oversampling sigma-delta ADC. State-of-the-art CD players make use 
of this technology. What does it take to achieve 16-bit quality using a 1-bit quantizer (which is just a sign 
detector)? Since A B = 15, we could, for example, use oversampling by N = 64 (to 2.8 MHz for audio signals 
sampled at 44.1 kHz) and p = 3 (third-order noise shaping). 


7.5 Digital Processing of Analog Signals 

The crux of the sampling theorem is not just the choice of an appropriate sampling rate. More important, 
the processing of an analog signal is equivalent to the processing of its Nyquist sampled version, because it 
retains the same information content as the original. This is how the sampling theorem is used in practice. 
It forms the link between analog and digital signal processing, and allows us to use digital techniques to 
manipulate analog signals. When we sample a signal x{t) at the instants nt s , we imply that the spectrum 
of the sampled signal is periodic with period S = l/t s and band-limited to a highest frequency B = 0 .5S. 
Figure 7.26 illustrates a typical system for analog-to-digital conversion. 



Figure 7.26 Block diagram of a system for analog-to-digital conversion 


An analog lowpass pre-filter or anti-aliasing filter (not shown) limits the highest analog signal frequency 
to allow a suitable choice of the sampling rate and ensure freedom from aliasing. The sampler operates 
above the Nyquist sampling rate and is usually a zero-order-hold device. The quantizer limits the sampled 
signal values to a finite number of levels (16-bit quantizers allow a signal-to-noise ratio close to 100 dB). The 
encoder converts the quantized signal values to a string of binary bits or zeros and ones (words) whose 
length is determined by the number of quantization levels of the quantizer. 

A digital signal processing system, in hardware or software (consisting of digital filters), processes the 
encoded digital signal (or bit stream) in a desired fashion. Digital-to-analog conversion essentially reverses 
the process and is accomplished by the system shown in Figure 7.27. 

A decoder converts the processed bit stream to a discrete signal with quantized signal values. The zero- 
order-hold device reconstructs a staircase approximation of the discrete signal. The lowpass analog post¬ 
filter, or anti-imaging filter, extracts the central period from the periodic spectrum, removes the unwanted 
replicas (images), and results in a smoothed reconstructed signal. 
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Figure 7.27 Block diagram of a system for analog-to-digital conversion 


7.5.1 Multirate Signal Processing and Oversampling 

In practice, different parts of a DSP system are often designed to operate at different sampling rates because 
of the advantages it offers. Since real-time digital filters must complete all algorithmic operations in one sam¬ 
pling interval, a smaller sampling interval (i.e. a higher sampling rate) can impose an added computational 
burden during the digital processing stage. It is for this reason that the sampling rate is often reduced (by 
decimation) before performing DSP operations and increased (by interpolation) before reconstruction. This 
leads to the concept of multirate signal processing where different subsystems operate at different sampling 
rates best suited for the given task. 

Oversampling does offer several advantages. At the input end, oversampling an analog signal prior to 
quantization allows the use of simple anti-aliasing filters. It also allows the use of quantizers with lower 
resolution (fewer bits) to achieve a given SNR because oversampling reduces the quantization noise level by 
spreading the quantization noise over a wider bandwidth. At the output end, oversampling of the processed 
digital signal (by sampling rate conversion) prior to reconstruction can reduce the errors (sine distortion) 
caused by zero-order-hold devices. It also allows us to use a DAC with lower resolution and a lower-order 
anti-imaging filter for final analog reconstruction. 

7.5.2 Practical ADC Considerations 

An analog-to-digital converter (ADC) for converting analog to digital signals consists of a sample-and-hold 
circuit followed by a quantizer and encoder. A block diagram of a typical sample-and-hold circuit and its 
practical realization is shown in Figure 7.28. 




r °lun __f Gr "“' 


-H IH- 


Block diagram of sample-and-hold system 


Implementation using an FET as a switch 


Figure 7.28 Block diagram of a sample-and-liold system and a practical realization 


A clock signal controls a switch (an FET, for example) that allows the hold capacitor C to charge 
very rapidly to the sampled value (when the switch is closed) and to discharge very slowly through the 
high input resistance of the buffer amplifier (when the switch is open). Ideally, the sampling should be as 
instantaneous as possible and, once acquired, the level should be held constant until it can be quantized and 
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encoded. Practical circuits also include an operational amplifier at the input to isolate the source from the 
hold capacitor and provide better tracking of the input. In practice, the finite aperture time Ta (during 
which the signal is being measured), the finite acquisition time Th (to switch from the hold mode to the 
sampling mode), the droop in the capacitor voltage (due to the leakage of the hold capacitor), and the finite 
conversion time Tc (of the quantizer) are all responsible for less than perfect performance. 

A finite aperture time limits both the accuracy with which a signal can be measured and the highest 
frequency that can be handled by the ADC. Consider the sinusoid x(t) = Asm(2nfot). Its derivative 
x'(t) = 27tA/ 0 cos(2tt f 0 t) describes the rate at which the signal changes. The fastest rate of change equals 
27 tA/o at the zero crossings of x(t). If we assume that the signal level can change by no more than AX 
during the aperture time Ta, we must satisfy 


2ttA/ 0 < 


AX 

~Ta 


or 


/o< 


AX 

ttDT a 


(7.37) 


where D = 2A corresponds to the full-scale range of the quantizer. Typically, AX may be chosen to equal the 
rms quantization error (which equals A/y/12) or 0.5 LSB (which equals 0.5A). In the absence of a sample- 
and-hold circuit (using only a quantizer), the aperture time must correspond to the conversion time of the 
quantizer. This time may be much too large to permit conversion of frequencies encountered in practice. An 
important reason for using a sample-and-hold circuit is that it holds the sampled value constant and allows 
much higher frequencies to be handled by the ADC. The maximum sampling rate S that can be used for 
an ADC (with a sample-and-hold circuit) is governed by the aperture time Ta, and hold time Th, of the 
sample-and-hold circuit, as well as the conversion time Tc of the quantizer, and corresponds to 


S< 


1 

T a + T h + T c 


(7.38) 


Naturally, this sampling rate must also exceed the Nyquist rate. During the hold phase, the capacitor 
discharges through the high input resistance R of the buffer amplifier, and the capacitor voltage is given 
by vc(t) = Voe~ t ' T , where Vo is the acquired value and r = RC. The voltage during the hold phase is 
not strictly constant but shows a droop. The maximum rate of change occurs at t = 0 and is given by 
v'(t) | t —o = —Vo /t. A proper choice of the holding capacitor C can minimize the droop. If the maximum 
droop is restricted to AC during the hold time Th, we must satisfy 


< AC 
RC ~ T h 


or 


C> 


V 0 T h 

RAV 


(7.39) 


To impose a lower bound, Co is typically chosen to equal the full-scale range, and AC may be chosen to 
equal the rms quantization error (which equals A/\/Y2) or 0.5 LSB (which corresponds to 0.5A). Naturally, 
an upper bound on C is also imposed by the fact that during the capture phase the capacitor must be able 
to charge very rapidly to the input level. 

A digital-to-analog converter (DAC) allows the coded and quantized signal to be converted to an analog 
signal. In its most basic form, it consists of a summing operational amplifier, as shown in Figure 7.29. 

The switches connect either to ground or to the input. The output voltage Co is a weighted sum of only 
those inputs that are switched in. If the resistor values are selected as 


Ro — R R\ 


R 

~2 


R-2 


R 

¥ 


■ ■ ■ Rn-1 — 


R 


(7.40) 


the output is given by 


V 0 = ~ Vl ^ ( bN ~^ N ~ 1 + b *~¥ N ~ 2 + • • • + M 1 + 6 0 2°) 


(7.41) 
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where the coefficients bk correspond to the position of the switches and equal 1 (if connected to the input) 
or 0 (if connected to the ground). Practical circuits are based on modifications that use only a few different 
resistor values (such as R and 2 R) to overcome the problem of choosing a wide range of resistor values 
(especially for high-bit converters). Of course, a 1-bit DAC simply corresponds to a constant gain. 


EXAMPLE 7.10 (ADC Considerations) 

(a) Suppose we wish to digitize a signal band-limited to 15 kHz using only a 12-bit quantizer. If we 
assume that the signal level can change by no more than the rms quantization error during capture, 
the aperture time Ta must satisfy 

AX _ D/2 B Vl2 _ 1 

' 4 “ tt-D/o 7rZ?/o 2 12 7 t(15)(10 3 ) 

The conversion time of most practical quantizers is much larger (in the microsecond range), and as a 
result, we can use such a quantizer only if it is preceded by a sample-and-hold circuit whose aperture 
time is less than 5 ns. 


(b) If we digitize a signal band-limited to 15 kHz, using a sample-and-hold circuit (with a capture time of 
4 ns and a hold time of 10 /is) followed by a 12-bit quantizer, the conversion time of the quantizer can 
be computed from 


S< 


1 

T a + T h + T c 


Ta + T h + Tc 


1 

(30) 10 3 


Tc = 23.3 /is 


The value of Tc is well within the capability of practical quantizers. 


(c) Suppose the sample-and-hold circuit is buffered by an amplifier with an input resistance of 1 Mf2. To 
ensure a droop of no more that 0.5 LSB during the hold phase, we require 

V 0 T h 


C> 


RAV 


Now, if Vo corresponds to the full-scale value, AV = 0.5 LSB = Vo/2 B+1 , and 

Vo T h (10)10 _6 2 13 


C> 


R{Vo/2 B+1 ) 


10 6 


81.9 nF 


©Ashok Ambardar, September 1, 2003 







7.5 Digital Processing of Analog Signals 


281 


7.5.3 Anti-Aliasing Filter Considerations 

The purpose of the anti-aliasing filter is to band-limit the input signal. In practice, however, we cannot 
design brick-wall filters, and some degree of aliasing is inevitable. The design of anti-aliasing filters must 
ensure that the effects of aliasing are kept small. One way to do this is to attenuate components above 
the Nyquist frequency to a level that cannot be detected by the ADC. The choice of sampling frequency 
S is thus dictated not only by the highest frequency of interest but also the resolution of the ADC. If the 
aliasing level is /SV and the maximum passbancl level is V, we require a filter with a stopband attenuation 
of A s > 20 log ^7 dB. If the peak signal level equals A , and the passband edge is defined as the half-power 
(or 3-dB) frequency, and /SV is chosen as the rms quantization error for a B-bit quantizer, we have 


A s > 20 log 


maximum rms passband level 
minimum rms stopband level 


A/V2 

A/Vl2 


A/V2 

A/(2 B V\2) 


201 og(2 s V6) dB 


(7.42) 


EXAMPLE 7.11 (Anti-Aliasing Filter Considerations) 

Suppose we wish to process a noisy speech signal with a bandwidth of 4 kHz using an 8 -bit ADC. 

We require a minimum stopband attenuation of A s = 20 log(2 B v / 6) ~ 56 dB. 

If we use a fourth-order Butterworth anti-aliasing filter with a 3-dB passband edge of f p , the normalized 
frequency v s = f s /f p at which the stopband attenuation of 56 dB occurs is computed from 

A s = 101og(l + i/g") v s = (l0 o lj4s - l) 1/2 " ss 5 

If the passband edge f p is chosen as 4 kHz, the actual stopband frequency is f s = y s f p — 20 kHz. 

If the stopband edge also corresponds to highest frequency of interest, then S = 40 kHz. 

The frequency f a that gets aliased to the passband edge f p corresponds to f a = S — f p = 36 kHz. 

The attenuation A a (in dB) at this frequency f a is 

A a = 101og(l + vl n ) = 101og(l + 9 8 ) « 76.3 dB 

This corresponds to a signal level (relative to unity) of (1.5)10 -4 , well below the rms quantization error 
(which equals 1 /( 2 B \/T 2 ) = 0 . 0011 ). 


7.5.4 Anti-Imaging Filter Considerations 

The design of reconstruction filters requires that we extract only the central image and minimize the sine 
distortion caused by practical zero-order-hold sampling. The design of such filters must meet stringent spec¬ 
ifications unless oversampling is employed during the digital-to-analog conversion. In theory, oversampling 
(at a rate much higher than the Nyquist rate) may appear wasteful, because it can lead to the manipulation 
of a large number of samples. In practice, however, it offers several advantages. First, it provides ade¬ 
quate separation between spectral images and thus allows filters with less stringent cutoff requirements to 
be used for signal reconstruction. Second, it minimizes the effects of the sine distortion caused by practical 
zero-order-hold sampling. Figure 7.30 shows staircase reconstructions at two sampling rates. 

The smaller steps in the staircase reconstruction for higher sampling rates lead to a better approximation 
of the analog signal, and these smaller steps are much easier to smooth out using lower-order filters with less 
stringent specifications. 
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Figure 7.30 Staircase reconstruction of a signal at low (left) and high (right) sampling rates 


EXAMPLE 7.12 (Anti-Imaging Filter Considerations) 

(a) Consider the reconstruction of an audio signal band-limited to 20 kHz, assuming ideal sampling. The 
reconstruction filter is required to have a maximum signal attenuation of 0.5 dB and to attenuate all 
images by at least 60 dB. 

The passband and stopband attenuations are A p = 0.5 dB at the passband edge f p = 20 kHz and 
A s = 60 dB at the stopband edge f s = S — f p = S — 20 kHz, where S is the sampling rate in kilohertz. 
This is illustrated in Figure E7.12A. 



Figure E7.12A Spectra for Example 7.12(a) 

If we design a Butterworth filter, its order n is given by 

log[(lQ° ,lj4a - 1 )/<T /2 , = _ 

log (/,//,) 

1. If we choose S = 44.1 kHz, we compute f s = 44.1 — 20 = 22.1 kHz and n = 80. 

2. If we choose S = 176.4 kHz (four-times oversampling), we compute f s = 176.4 — 20 = 156.4 kHz 
and n = 4. This is an astounding reduction in the filter order 


(b) If we assume zero-order-hold sampling and S = 176.4 kHz, the signal spectrum is multiplied by 
sine (f/S). This already provides a signal attenuation of — 20 log [sine (20/176.4)] = 0.184 dB at the 
passband edge of 20 kHz and —20 log[sinc(156.4/176.4)] = 18.05 dB at the stopband edge of 156.4 kHz. 
The new filter attenuation specifications are thus A p = 0.5 — 0.184 = 0.316 dB and A s = 60 — 18.05 = 
41.95 dB, and we require a Butterworth filter whose order is given by 


_ log[(10°-^- - l)/e 2 ] 1/2 

log(/ s // P ) 


n = 3 
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We see that oversampling allows us to use reconstruction filters of much lower order. In fact, the 
earliest commercial CD players used four-times oversampling (during the DSP stage) and second-order 
or third-order Bessel reconstruction filters (for linear phase). 

The effects of sine distortion may also be minimized by using digital filters with a 1/sinc response 
during the DSP phase itself (prior to reconstruction). 


7.6 Compact Disc Digital Audio 

One application of digital signal processing that has had a profound effect on the consumer market is in 
compact disc (CD) digital audio systems. The human ear is an incredibly sensitive listening device that 
depends on the pressure of the air molecules on the eardrum for the perception of sound. It covers a 
whopping dynamic range of 120 dB, from the Brownian motion of air molecules (the threshold of hearing) 
all the way up to the threshold of pain. The technology of recorded sound has come a long way since 
Edison’s invention of the phonograph in 1877. The analog recording of audio signals on long-playing (LP) 
records suffers from poor signal-to-noise ratio (about 60 dB), inadequate separation between stereo channels 
(about 30 dB), wow and flutter, and wear due to mechanical tracking of the grooves. The CD overcomes 
the inherent limitations of LP records and cassette tapes and yields a signal-to-noise ratio, dynamic range, 
and stereo separation, all in excess of 90 dB. It makes full use of digital signal processing techniques during 
both recording and playback. 

7.6.1 Recording 

A typical CD recording system is illustrated in Figure 7.31. The analog signal recorded from each microphone 
is passed through an anti-aliasing filter, sampled at the industry standard of 44.1 kHz and quantized to 16 
bits in each channel. The two signal channels are then multiplexed, the multiplexed signal is encoded, and 
parity bits are added for later error correction and detection. Additional bits are also added to provide 
information for the listener (such as playing time and track number). The encoded data is then modulated 
for efficient storage, and more bits (synchronization bits) are added for subsequent recovery of the sampling 
frequency. The modulated signal is used to control a laser beam that illuminates the photosensitive layer 
of a rotating glass disc. As the laser turns on or off, the digital information is etched on the photosensitive 
layer as a pattern of pits and lands in a spiral track. This master disk forms the basis for mass production 
of the commercial CD from thermoplastic material. 



Figure 7.31 Components of a compact disc recording system 

How much information can a CD store? With a sampling rate of 44.1 kHz and 32 bits per sample (in 
stereo), the bit rate is (44.1)(32) 10 3 = (1.41) 10 6 audio bits per second. After encoding, modulation, and 
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synchronization, the number of bits roughly triples to give a bit rate of (4.23)10® channel bits per second. 
For a recording time of an hour, this translates to about 600 megabytes (with 8 bits corresponding to a byte 
and 1024 bytes corresponding to a kilobyte). 

7.6.2 Playback 

The CD player reconstructs the audio signal from the information stored on the compact disc in a series 
of steps that essentially reverses the process at the recording end. A typical CD player is illustrated in 
Figure 7.32. During playback, the tracks on a CD are optically scanned by a laser to produce a digital 
signal. This digital signal is demodulated, and the parity bits are used for the detection of any errors (due 
to manufacturing defects or dust, for example) and to correct the errors by interpolation between samples 
(if possible) or to mute the signal (if correction is not possible). The demodulated signal is now ready for 
reconstruction using a DAC. However, the analog reconstruction filter following the DAC must meet tight 
specifications in order to remove the images that occur at multiples of 44.1 kHz. Even though the images are 
well above the audible range, they must be filtered out to prevent overloading of the amplifier and speakers. 
What is done in practice is to digitally oversample the signal (by a factor of 4) to a rate of 176.4 kHz and 
pass it through the DAC. A digital filter that compensates for the sine distortion of the hold operation is 
also used prior to digital-to-analog conversion. Oversampling relaxes the requirements of the analog filter, 
which must now smooth out much smaller steps. The sine compensating filter also provides an additional 
attenuation of 18 dB for the spectral images and further relaxes the stopband specifications of the analog 
reconstruction filter. The earliest systems used a third-order Bessel filter with a 3-dB passband of 30 kHz. 
Another advantage of oversampling is that it reduces the noise floor and spreads the quantization noise over 
a wider bandwidth. This allows us to round the oversampled signal to 14 bits and use a 14-bit DAC to 
provide the same level of performance as a 16-bit DAC. 



Figure 7.32 Components of a compact disc playback system 


7.7 Dynamic Range Processors 

There are many instances in which an adjustment of the dynamic range of a signal is desirable. Sound 
levels above 100 dB appear uncomfortably loud, and the dynamic range should be matched to the listening 
environment for a pleasant listening experience. Typically, compression is desirable when listening to music 
with a large dynamic range in small enclosed spaces (unlike a concert hall) such as a living room or an 
automobile where the ambient (background) noise is not very low. For example, if the music has a dynamic 
range of 80 dB and the background noise is 40 dB above the threshold of hearing, it can lead to sound 
levels as high as 120 dB (close to the threshold of pain). Dynamic range compression is also desirable for 
background music (in stores or elevators). It is also used to prevent distortion when recording on magnetic 
tape, and in studios to adjust the dynamic range of the individual tracks in a piece of recorded music. 

There are also situations where we may like to expand the dynamic range of a signal. For example, the 
dynamic range of LP records and cassette tapes is not very high (typically, between 50 dB and 70 dB) and 
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can benefit from dynamic range expansion, which in effect makes loud passages louder and soft passages 
softer and in so doing also reduces the record or tape hiss. 

A compressor is a variable gain device whose gain is unity for low signal levels and decreases at higher 
signal levels. An expander is an amplifier with variable gain (which never exceeds unity). For high signal 
levels it provides unity gain, whereas for low signal levels it decreases the gain and makes the signal level 
even lower. Typical compression and expansion characteristics are shown in Figure 7.33 and are usually 
expressed as a ratio, such as a 2:1 compression or a 1:4 expansion. A 10:1 compression ratio (or higher) 
describes a limiter and represents an extreme form of compression. A 1:10 expansion ratio describes a noise 
gate whose output for low signal levels may be almost zero. Noise gating is one way to eliminate noise or 
hiss during moments of silence in a recording. 


Dynamic range compression 
'Output level (dB) 


No compression 



2:1 compression 
4:1 compression 
10:1 compression 
(limiter) 


Dynamic range expa 



Threshold Input level (dB) 

Figure 7.33 Input-output characteristics of dynamic range processors 



Analoa level detector 



Figure 7.34 Block digram of a dynamic range processor 


Control of the dynamic range requires variable gain devices whose gain is controlled by the signal level, 
as shown in Figure 7.34. Dynamic range processing uses a control signal c(t) to adjust the gain. If the 
gain decreases with increasing c(t), we obtain compression; if the gain increases with increasing c(f), we 
obtain expansion. Following the signal too closely is undesirable because it would eliminate the dynamic 
variation altogether. Once the signal level exceeds the threshold, a typical compressor takes up to 0.1 s 
(called the attack time) to respond, and once the level drops below threshold, it takes another second or 
two (called the release time) to restore the gain to unity. Analog circuits for dynamic range processing may 
use a peak detector (much like the one used for the detection of AM signals) that provides a control signal. 
Digital circuits replace the rectifier by simple binary operations and simulate the control signal and the 
attack characteristics and release time by using digital filters. In concept, the compression ratio (or gain), 
the delay, attack, and release characteristics may be adjusted independently. 
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7.7.1 Companders 

Dynamic range expanders and compressors are often used to combat the effects of noise during transmission 
of signals, especially if the dynamic range of the channel is limited. A compander is a combination of a 
compressor and expander. Compression allows us to increase the signal level relative to the noise level. An 
expander at the receiving end returns the signal to its original dynamic range. This is the principle behind 
noise reduction systems for both professional and consumer use. An example is the Dolby noise reduction 
system. 

In the professional Dolby A system, the input signal is split into four bands by a lowpass filter with a 
cutoff frequency of 80 Hz, a bandpass filter with band edges at [80, 3000] Hz, and two highpass filters with 
cutoff frequencies of 3 kHz and 8 kHz. Each band is compressed separately before being mixed and recorded. 
During playback, the process is reversed. The characteristics of the compression and expansion are shown 
in Figure 7.35. 


♦ Output level (dB) 



Compressior 
Expansion di 


Figure 7.35 Compression and expansion characteristics for Dolby A noise reduction 


During compression, signal levels below —40 dB are boosted by a constant 10 dB, signal levels between 
—40 dB and —20 dB are compressed by 2:1, and signal levels above —20 dB are not affected. During playback 
(expansion), signal levels above —20 dB are cut by 10 dB, signal levels between —30 dB and —20 dB face a 1:2 
expansion, and signal levels below —30 dB are not affected. In the immensely popular Dolby B system found 
in consumer products (and also used by some FM stations), the input signal is not split but a pre-emphasis 
circuit is used to provide a high-frequency boost above 600 Hz. Another popular system is dbx, which uses 
pre-emphasis above 1.6 kHz with a maximum high-frequency boost of 20 dB. 

Voice-grade telephone communication systems also make use of dynamic range compression because the 
distortion caused is not significant enough to affect speech intelligibility. Two commonly used compressors 
are the /./-law compander (used in North America and Japan) and the A-law compander (used in Europe). 
For a signal x(t ) whose peak level is normalized to unity, the two compression schemes are defined by 


Vu(x) 


ln(l + p\x\) 
ln(l + p) 


sgn(x) 


Va(x ) = 


A \x\ 

1 + In A 


sgn(x), 


1 + ln(A|a;|) 
1 + In A 


sgn(cc), 


0 < M < \ 
A < M < 1 


(7.43) 


The characteristics of these compressors are illustrated in Figure 7.36. The value p = 255 has become 
the standard in North America, and A = 100 is typically used in Europe. For p = 0 (and A = 1), there is no 
compression or expansion. The p -law compander is nearly linear for p\x\ <C 1. In practice, compression is 
based on a piecewise linear approximation of the theoretical p -law characteristic and allows us to use fewer 
bits to digitize the signal. At the receiving end, an expander (ideally, a true inverse of the compression law) 
restores the dynamic range of the original signal (except for the effects of quantization). The inverse for 
p -law compression is 


_ ( 1+^1 - 1 
d 


(7.44) 
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Figure 7.36 Characteristics of fi -law and A-law compressors 


The quantization of the compressed signal using the same number of bits as the uncompressed signal results 
in a higher quantization SNR. For example, the value of /x = 255 increases the SNR by about 24 dB. Since 
the SNR improves by 6 dB per bit, we can use a quantizer with fewer (only B — 4) bits to achieve the same 
performance as a R-bit quantizer with no compression. 


7.8 Audio Equalizers 

Audio equalizers are typically used to tailor the sound to suit the taste of the listener. The most common 
form of equalization is the tone controls (for bass and treble, for example) found on most low-cost audio 
systems. Tone controls employ shelving filters that boost or cut the response over a selected frequency band 
while leaving the rest of the spectrum unaffected (with unity gain). As a result, the filters for the various 
controls are typically connected in cascade. Graphic equalizers offer the next level in sophistication and 
employ a bank of (typically, second-order) bandpass filters covering a fixed number of frequency bands, and 
with a fixed bandwidth and center frequency for each range. Only the gain of each filter can be adjusted by 
the user. Each filter isolates a selected frequency range and provides almost zero gain elsewhere. As a result, 
the individual sections are connected in parallel. Parametric equalizers offer the ultimate in versatility 
and comprise filters that allow the user to vary not only the gain but also the filter parameters (such as 
the cutoff frequency, center frequency, and bandwidth). Each filter in a parametric equalizer affects only a 
selected portion of the spectrum (providing unity gain elsewhere), and as a result, the individual sections 
are connected in cascade. 

7.8.1 Shelving Filters 

To vary the bass and treble content, it is common to use first-order shelving filters with adjustable gain 
and cutoff frequency. The transfer function of a first-order lowpass filter whose dc gain is unity and whose 
response goes to zero at F = 0.5 (or z = —1) is described by 


< 7 - 45 > 

The half-power or 3-dB cutoff frequency flc of this filter is given by 

n ° = “^‘(rfdd (746) 
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The transfer function of a first-order highpass filter with the same cutoff frequency flc is simply 7 /hp(~) = 
1 — Hlp(z), and gives 

<™> 

Its gain equals zero at F = 0 and unity at F = 0.5. 

A lowpass shelving filter consists of a first-order lowpass filter with adjustable gain G in parallel with a 
highpass filter. With Hpp(z) + Hpp(z) = 1, its transfer function may be written as 

ff SL = GHpp(z) + H H p(z) = 1 + (G - l)Hpp(z) (7.48) 

A highpass shelving filter consists of a first-order highpass filter with adjustable gain G in parallel with a 
lowpass filter. With Hpp(z) + 7?hp (z) = 1, its transfer function may be written as 

Hsu = GHhp(z) + Hpp(z) = 1 + (G — 1)I7hp(z) (7.49) 

The realizations of these lowpass and highpass shelving filters are shown in Figure 7.37. 




Figure 7.37 Realizations of lowpass and highpass shelving filters 


The response of a lowpass and highpass shelving filter is shown for various values of gain (and a fixed 
a) in Figure 7.38. For G > 1, the lowpass shelving filter provides a low-frequency boost, and for 0 < G < 1 
it provides a low-frequency cut. For G = 1, we have T/sl = 1, and the gain is unity for all frequencies. 
Similarly, for G > 1, the highpass shelving filter provides a high-frequency boost, and for 0 < G < 1 it 
provides a high-frequency cut. In either case, the parameter a allows us to adjust the cutoff frequency. 
Practical realizations of shelving filters and parametric equalizers typically employ allpass structures. 

7.8.2 Graphic Equalizers 

Graphic equalizers permit adjustment of the tonal quality of the sound (in each channel of a stereo system) 
to suit the personal preference of a listener and represent the next step in sophistication, after tone controls. 
They employ a bank of (typically, second-order) bandpass filters covering the audio frequency spectrum, and 
with a fixed bandwidth and center frequency for each range. Only the gain of each filter can be adjusted 
by the user. Each filter isolates a selected frequency range and provides almost zero gain elsewhere. As a 
result, the individual sections are connected in parallel , as shown in Figure 7.39. 

The input signal is split into as many channels as there are frequency bands, and the weighted sum of 
the outputs of each filter yields the equalized signal. A control panel, usually calibrated in decibels, allows 
for gain adjustment by sliders, as illustrated in Figure 7.39. The slider settings provide a rough visual 
indication of the equalized response, hence the name graphic equalizer. The design of each second-order 
bandpass section is based on its center frequency and its bandwidth or quality factor Q. A typical set of 
center frequencies for a ten-band equalizer is [31.5, 63, 125, 250, 500, 1000, 2000, 4000, 8000, 16000] Hz. A 
typical range for the gain of each filter is ±12 dB (or 0.25 times to 4 times the nominal gain). 
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Lowpass Shelving filter: alpha=0.85 Highpass Shelving filter: alpha=0.85 



10 3 10 2 10 1 10 3 10“ 2 10 1 
Digital Frequency [F] Digital Frequency [F] 


Figure 7.38 Frequency response of lowpass and highpass shelving filters 



Figure 7.39 A graphic equalizer (left) and the display panel (right) 


EXAMPLE 7.13 (A Digital Graphic Equalizer) 

We design a five-band audio equalizer operating at a sampling frequency of 8192 Hz, with center frequencies 
of [120, 240, 480, 960, 1920] Hz. We select the 3-dB bandwidth of each section as 0.75 times its center 
frequency to cover the whole frequency range without overlap. This is equivalent to choosing each section 
with Q = 4/3. Each section is designed as a second-order bandpass HR filter. Figure E7.13 shows the 
spectrum of each section and the overall response. The constant Q design becomes much more apparent 
when the gain is plotted in dB against log(/), as shown in Figure E7.13(b). A change in the gain of any 
section results in a change in the equalized response. 
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(a) Gain of five-band equalizer 




Figure E7.13 Frequency response of the audio equalizer for Example 7.13 


7.8.3 Parametric Equalizers 

Parametric equalizers offer the ultimate in versatility and allow the user to vary not only the gain but 
also the filter parameters (such as the cutoff frequency, center frequency, and bandwidth). Each filter in a 
parametric equalizer affects only a selected portion of the spectrum (while providing unity gain elsewhere), 
and as a result, the individual sections are connected in cascade. Most parametric equalizers are based on 
second-order HR peaking or notch filters whose transfer functions we reproduce here: 


Hbp{z) — 


C z 2 - 1 

1 + C [ z 2 - -AL z+ 

\ z 1 +C Z ^ 1+C , 


Hbs{z) = 


1 / z 2 -2(3z + 1 

1 + C l +2 _ W_ z+ i=c 

1 +C Z ^ 1+C , 


The center frequency and bandwidth for the filters are given by 

2a 


O 0 = cos f3 AO = cos 


-l 


1 + a 2 


where a = 


l-C 
1 + C 


(7.50) 


(7.51) 


It is interesting to note that Hbs(z) = 1 — Hbp(z). A tunable second-order equalizer stage Hpar{z) consists 
of the bandpass filter Hbp(z), with a peak gain of G, in parallel with the bandstop filter Ubs(~) : 


-ffpAR(^) = GHbp{z) + Hbs{z) = 1 + (G — 1)Hbp{z) 
A realization of this filter is shown in Figure 7.40. 


(7.52) 



©Ashok Ambardar, September 1, 2003 







7.9 Digital Audio Effects 


291 


For G = 1, we have T/par = 1, and the gain is unity for all frequencies. The parameters a and (3 allow 
us to adjust the bandwidth and the center frequency, respectively. The response of this filter is shown for 
various values of these parameters in Figure 7.41. 



(c) Peaking filter: G=4, p=0.5 



0 __ 

0 0.25 0.5 


Digital frequency F 


Figure 7.41 Typical response of a parametric equalizer 


7.9 Digital Audio Effects 

Signal processing techniques allow us not only to compensate for the acoustics of a listening environment, 
but also to add special musical effects such as delay, echo, and reverb, if desired. The most common example 
is the audio equalizer that allows us to enhance the bass or treble content of an audio signal. What a listener 
hears in a room depends not only on the acoustic characteristics of that room, but also on the location of the 
listener. A piece of music recorded in a concert hall does not sound quite the same elsewhere. The ambiance 
of a concert hall can, however, be duplicated in the living room environment by first compensating for the 
room acoustics, and then adding the reverberation characteristics of the concert hall. The compensation 
is achieved by passing the audio signal through an inverse filter corresponding to the impulse response of 
the room (which can be measured). The concert hall ambiance is then added by a filter that simulates the 
concert hall acoustics. High-end audio systems allow us not only to measure the room acoustics, but also to 
simulate the acoustics of a variety of well-known concert hall environments. 

In any listening space, what we hear from an audio source consists not only of the direct sound, but also 
early echoes reflected directly from the walls and other structures, and a late sound or reverberation that 
describes multiple reflections (that get added to other echoes). This is illustrated in Figure 7.42. 


1 Direct sound 

Early reflections 
(echo) 

Late reflections 
:. (reverb) 

Ti:'--. t 


Source 



Figure 7.42 Illustrating echo and reverb 


The direct sound provides clues to the location of the source, the early echoes provide an indication of 
the physical size of the listening space, and the reverberation characterizes the warmth and liveliness that 
we usually associate with sounds. The amplitude of the echoes and reverberation decays exponentially with 


©Ashok Ambardar, September 1, 2003 












292 


Chapter 7 Digital Processing of Analog Signals 


time. Together, these characteristics determine the psycho-acoustic qualities we associate with any perceived 
sound. Typical 60-dB reverberation times (for the impulse response to decay to 0.001 of its peak value) for 
concert halls are fairly long, up to two seconds. A conceptual model of a listening environment, also shown 
in Figure 7.42, consists of echo filters and reverb filters. 

A single echo can be modeled by a feed-forward system of the form 

y[n] = x[n] + ax[n — D] H(z) = l + az D h[n] = S[n] — aS[n — D] (7.53) 

This is just a comb filter in disguise. The zeros of this filter lie on a circle of radius R — a 1 / D , with angular 
orientations of O = (2k + 1 )tt/D. Its comb-like magnitude spectrum H(F) shows minima of 1 — a at the 
frequencies F = (2k + 1) /D, and peaks of 1 + a midway between the dips. To perceive an echo, the index 
D must correspond to a delay of at least about 50 ms. 

A reverb filter that describes multiple reflections has a feedback structure of the form 

y[n] = ay[n — D] + x[n] H(z) = --( 7 . 54 ) 

This filter has an inverse-comb structure, and its poles lie on a circle of radius R = a l ^ D , with an angular 
separation of = 2tt/D. The magnitude spectrum shows peaks of 1/(1 —a) at the pole frequencies F = k/D, 
and minima of 1/(1 + a) midway between the peaks. 

Conceptually, the two systems just described can form the building blocks for simulating the acoustics 
of a listening space. Many reverb filters actually use a combination of reverb filters and allpass filters. A 
typical structure is shown in Figure 7.43. In practice, however, it is more of an art than a science to create 
realistic effects, and many of the commercial designs are propriety information. 



Figure 7.43 Echo and reverb filters for simulating acoustic effects 


The reverb filters in Figure 7.43 typically incorporate irregularly spaced delays to allow the blending of 
echoes, and the allpass filter serves to create the effect of early echoes. Some structures for the reverb filter 
and allpass filter are shown in Figure 7.44. The first structure is the plain reverb. In the second structure, 
the feedback path incorporates a first-order lowpass filter that accounts for the dependence (increase) of 
sound absorption with frequency. The allpass filter has the form 


H(z) = 


—a + z 
1 — az 1 


-L 


1 


— — a 


1 — az 


-L 


(7.55) 


The second form of this expression (obtained by long division) shows that, except for the constant term, the 
allpass filter has the same form as a reverb filter. 


7.9.1 Gated Reverb and Reverse Reverb 

Two other types of audio effects can also be generated by reverb filters. A gated reverb results from the 
truncation (abrupt or gradual) of the impulse response of a reverb filter, resulting in an FIR filter. A reverse 
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Reverb filter 



Reverb with lowpass filter 



Figure 7.44 Realization of typical reverb filters 


reverb is essentially a folded version of the impulse response of a gated reverb filter. The impulse response 
increases with time, leading to a sound that first gets louder, and then dies out abruptly. 

7.9.2 Chorusing, Flanging, and Phasing 

The echo filter also serves as the basis for several other audio special effects. Two of these effects, chorusing 
and phasing, are illustrated in Figure 7.45. 



Chorusine Phasine 


Figure 7.45 Illustrating special audio effects 

Chorusing mimics a chorus (or group) singing (or playing) in unison. In practice, of course, the voices 
(or instruments) are not in perfect synchronization, nor identical in pitch. The chorusing effect can be 
implemented by a weighted combination of echo filters, each with a time-varying delay d n of the form 

■y[n\ = x[n] + ax[n — d n ] (7.56) 

Typical delay times used in chorusing are between 20 ms and 30 ms. If the delays are less than 10 ms (but 
still variable), the resulting “whooshing” sound is known as flanging. 

Phase shifting or phasing also creates many interesting effects, and may be achieved by passing the 
signal through a notch filter whose frequency can be tuned by the user. It is the sudden phase jumps at 
the notch frequency that are responsible for the phasing effect. The effects may also be enhanced by the 
addition of feedback. 

7.9.3 Plucked-String Filters 

Comb filters, reverb filters, and allpass filters have also been used to synthesize the sounds of plucked 
instruments, such as the guitar. What we require is a filter that has a comb-like response, with resonances 
at multiples of the fundamental frequency of the note. We also require that the harmonics decay in time, 
with higher frequencies decaying at a faster rate. A typical structure, first described by Karplus and Strong, 
is illustrated in Figure 7.46. 
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G lp (z) 



Figure 7.46 The Karplus-Strong plucked-string filter 


In the Karplus-Strong structure, the lowpass filter has the transfer function Glp(2 ) = 0.5(1 + z _1 ), and 
contributes a 0.5-sample phase delay. The delay line contributes an additional D-sample delay, and the loop 
delay is thus D + 0.5 samples. The overall transfer function of the first structure is 

H(z)= - } ( \ G lp ( 2 ) = 0.5(1 + *- 1 ) (7.57) 

1 - Az u Glp{z) 

The frequency response of this Karplus-Strong filter is shown in Figure 7.47, for D = 8 and D = 16, 
and clearly reveals a resonant structure with sharp peaks. The lowpass filter Glp(z) is responsible for the 
decrease in the amplitude of the peaks, and for making them broader as the frequency increases. 


(a) Karplus-Strong filter: D = 8. A = 0.9 


(b) Karplus-Strong filter: D = 16. A = 0.9 




Figure 7.47 Frequency response of the Karplus-Strong plucked-string filter 


If A is close to unity, the peaks occur at (or very close to) multiples of the fundamental digital frequency 
F 0 = 1/(1? + 0.5). For a sampling rate S, the note frequency thus corresponds to /o = S/(D + 0.5) Hz. 
However, since D is an integer, we cannot achieve precise tuning (control of the frequency). For example, 
to generate a 1600-Hz note at a sampling frequency of 14 kHz requires that D + 0.5 = 8.75. The closest we 
can come is by picking D = 8 (to give a frequency of ,/o = w 1647 Hz). To generate the exact frequency 
requires an additional 0.25-sample phase delay. The second structure of Figure 18.46 includes an allpass 
filter of the form Gap (z) = (1 + az)/{z + a) in the feedback path that allows us to implement such fractional 
delays by appropriate choice of the allpass parameter a. Recall that the delay of this allpass filter, at low 
frequencies at least, is approximated by 


Dap 


1 — a 


1 + a 


1 — Dap 
1 + Dap 


(7.58) 


In order to implement the 0.25-sample delay, we require 


1-0.25 
1 + 0.25 


= 0.6 
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In order to synthesize the sound of a plucked instrument, we require a reverb (or comb) filter (with its 
integer delay) to provide the multiple resonances, a lowpass filter to ensure that the resonances decay with 
frequency, and an allpass filter (with its fractional delay and constant gain) to fine-tune the note frequency. 

7.10 Digital Oscillators and DTMF Receivers 

The impulse response and transfer function of a causal oscillator that generates a pure cosine are 

•y ^ — -7 O 

h[n\ = cos(nf2)u[n] H {z )= ^ ^ x (7.59) 

Similarly, a system whose impulse response is a pure sine is given by 

bin] = sin (nfi)«[n] H(z) = g2 _^n + l (7 ' 60) 

The realizations of these two systems, called digital oscillators, are shown in Figure 7.48. 



(ti Q .) u [ n ] 



Figure 7.48 Realization of cosine and sine digital oscillators 


7.10.1 DTMF Receivers 

A touch-tone phone or dual-tone multi-frequency (DTMF) transmitter/receiver makes use of digital oscilla¬ 
tors to generate audible tones by pressing buttons on a keypad, as shown in Figure 7.49. Pressing a button 
produces a two-tone signal containing a high- and a low-frequency tone. Each button is associated with a 
unique pair of low-frequency and high-frequency tones. For example, pressing the button marked [ 5 ] would 
generate a combination of 770-Hz and 1336-Hz tones. There are four low frequencies and four high frequen¬ 
cies. The low- and high-frequency groups have been chosen to ensure that the paired combinations do not 
interfere with speech. The highest frequency (1633 Hz) is not currently in commercial use. The tones can be 
generated by using a parallel combination of two programmable digital oscillators, as shown in Figure 7.50. 

The sampling rate typically used is S = 8 kHz. The digital frequency corresponding to a typical high- 
frequency tone fu is Off = 27 tJh/S. The code for each button selects the appropriate filter coefficients. 

The keys pressed are identified at the receiver by first separating the low- and high-frequency groups using 
a lowpass filter (with a cutoff frequency of around 1000 Hz) and a highpass filter (with a cutoff frequency 
of around 1200 Hz) in parallel, and then isolating each tone, using a parallel bank of narrow-band bandpass 
filters tuned to the (eight) individual frequencies. The (eight) outputs are fed to a level detector and decision 
logic that establishes the presence or absence of a tone. The keys may also be identified by computing the 
FFT of the tone signal, followed by threshold detection. 
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Figure 7.49 Layout of a DTMF touch-tone keypad 



CHAPTER 7 PROBLEMS 


7.1 (Sampling Operations) The signal x(t) = cos(40007rf) is sampled at intervals of t s . Sketch the 
sampled signal over 0 < t < 2 ms and also sketch the spectrum of the sampled signal over a frequency 
range of at least —5 kHz < / < 5 kHz for the following choices of the sampling function and t s . 

(a) Impulse train (ideal sampling function) with t s = 0.2 ms 

(b) Impulse train (ideal sampling function) with t s = 0.8 ms 

(c) Rectangular pulse train with pulse width td = 0.1 ms and t s = 0.2 ms 

[Hints and Suggestions: The spectrum X(f) = 0.5 S(f — B) + 0.5 6(f + B) is an impulse pair. The 
spectrum of the sampled signals is J2 X[k]X(f — k/t s ). In parts (a)-(b), X[k\ = l/t s and the impulses 
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are replicated every S = l/t s Hz. For (c), X[k] = 0.5sinc(0.5fc) and the replicated impulses decay in 
strength.] 

7.2 (Sampling Operations) The signal x(t) = sinc(4000f) is sampled at intervals of t s . Sketch the 
sampled signal over 0 < t < 2 ms and also sketch the spectrum of the sampled signal for the following 
choices of the sampling function and t s 

(a) Impulse train (ideal sampling function) with t s = 0.2 ms 

(b) Impulse train (ideal sampling function) with t s = 0.25 ms 

(c) Impulse train (ideal sampling function) with t s = 0.4 ms 

(d) Rectangular pulse train with pulse width td = 0.1 ms and t s = 0.2 ms 

(e) Flat-top (zero-order-hold) sampling with t s = 0.2 ms 

[Hints and Suggestions: X(f) = ^d_,rect( is a rectangular pulse. The spectrum of the sampled 
signals is X[k]X(f — k/t s ). In parts (a)-(c), X[k\ = l/t s and the pulses are replicated every S = l/t s 
Hz and added (where they overlap). For (d), A[fc] = 0.5sinc(0.5/c) and the replicated pulses decrease 
in height. For (e), the spectrum of (d) is multiplied by sinc(//5).] 

7.3 (Digital Frequency) Express the following signals using a digital frequency \F\ < 0.5. 

(a) x[n} = cos(^p) 

(b) x[n] = cos(^) ±sin(^) 

7.4 (Sampling Theorem) Establish the Nyquist sampling rate for the following signals. 

(a) x(t) = 5sin(3007rf + x/3) (b) x(t) = cos(3007rf) — sin(3007rt + 51°) 

(c) x(t) = 3cos(3007rf) + 5 sin(5007rf) (d) x(t) = 3 cos(3007rf)sin(5007rf) 

(e) x{t) = 4cos 2 (1007rt) (f) x{t) = 6sinc(100t) 

(g) x(t) = 10 sine 2 (lOOt) (h) x(t) = 6 sinc(100t)cos(2007rf) 

[Hints and Suggestions: For the product signals, time-domain multiplication means convolution of 
their spectra. The width of this convolution gives the highest frequency. For example, in (d), the 
spectra extend to ±150 Hz and ±250 Hz, their convolution covers ±400 Hz, and / max = 400 Hz.] 

7.5 (Sampling Theorem) A sinusoid x(t) = Acos(27r/ot) is sampled at three times the Nyquist rate for 
six periods. How many samples are acquired? 

[Hints and Suggestions: For sinusoids, the Nyquist rate means taking two samples per period.] 

7.6 (Sampling Theorem) The sinusoid x(t) = Acos(27r/ot) is sampled at twice the Nyquist rate for 1 s. 
A total of 100 samples is acquired. What is /o and the digital frequency of the sampled signal? 

[Hints and Suggestions: For sinusoids, the Nyquist rate means taking two samples per period.] 

7.7 (Sampling Theorem) A sinusoid x(t) = sin(1507rf) is sampled at a rate of five samples per three 
periods. What fraction of the Nyquist sampling rate does this correspond to? What is the digital 
frequency of the sampled signal? 

[Hints and Suggestions: For sinusoids, the Nyquist rate means taking two samples per period.] 

7.8 (Sampling Theorem) A periodic square wave with period T = 1 ms whose value alternates between 
±1 and —1 for each half-period is passed through an ideal lowpass filter with a cutoff frequency of 
4 kHz. The filter output is to be sampled. What is the smallest sampling rate we can choose? Consider 
both the symmetry of the signal as well as the Nyquist criterion. 

[Hints and Suggestions: Even-indexed harmonics are absent if the signal is half-wave symmetric.] 
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7.9 (Spectrum of Sampled Signals) Given the spectrum X(f) of an analog signal x(t), sketch the 
spectrum of its ideally sampled version x[n], assuming a sampling rate of 50, 40, and 30 Hz. 

(a) X{f) = rect(//40) (b) X(f) = tri(//20) 

[Hints and Suggestions: The spectrum of the sampled signals is ^2 SX (/ — kS). The images of 
SX(f) are replicated every S Hz and added (where they overlap).] 

7.10 (Spectrum of Sampled Signals) Sketch the spectrum of the following signals against the digital 
frequency F. 

(a) x(t) = cos(2007rt), ideally sampled at 450 Hz 

(b) x(t) = sin(4007rf — J), ideally sampled at 300 Hz 

(c) x(t) = cos(2007rt) + sin(3507rt), ideally sampled at 300 Hz 

(d) x(t) = cos(2007rt + f) + sin(2507rt — j), ideally sampled at 120 Hz 

[Hints and Suggestions: The spectrum X(f) contains impulse pairs. The spectrum of the ideally 
sampled signals is J2 SX(f — kS). The images of SX(f) are replicated every S Hz.] 

7.11 (Sampling and Aliasing) A signal x(t) is made up of the sum of pure sines with unit peak value at 
the frequencies 10, 40, 200, 220, 240, 260, 300, 320, 340, 360, 380, and 400 Hz. 

(a) Sketch the magnitude and phase spectra of x(t). 

(b) If x(t) is sampled at S = 140 Hz, which components, if any, will show aliasing? 

(c) The sampled signal is passed through an ideal reconstruction filter whose cutoff frequency is 
fc = 0.5 S. Write an expression for the reconstructed signal y(t) and sketch its magnitude 
spectrum and phase spectrum. Is y(t) identical to x{t)l Should it be? Explain. 

(d) What minimum sampling rate S will allow ideal reconstruction of x(i) from its samples? 

7.12 (Sampling and Aliasing) The signal x(t) = cos(1007rt) is applied to the following systems. Is it 
possible to find a minimum sampling rate required to sample the system output y(t)l If so, find the 
Nyquist sampling rate. 

(a) y(t) = x 2 (t) (b) y(t) = x 3 {t) 

(c) y(t) = |x(t)| (d) h(t) = sinc(200f) 

(e) h(t) = sinc(500f) (f) h(t) = S(t — 1) 

(g) y(t) = x(t)cos(4007rt) (h) y(t) = u[x{t)\ 

[Hints and Suggestions: The Nyquist rate applies only if y(t) is bandlimited. In (b), y(t) is a 
periodic full-rectified cosine. In (h), y(t) is a periodic square wave.] 

7.13 (Sampling and Aliasing) The sinusoid x(t) = cos(27r/ot + 6) is sampled at 400 Hz and shows up as 
a 150-Hz sinusoid upon reconstruction. When the signal x(t) is sampled at 500 Hz, it again shows up 
as a 150-Hz sinusoid upon reconstruction. It is known that /o < 2.5 kHz. 

(a) If each sampling rate exceeds the Nyquist rate, what is /o? 

(b) By sampling x(t) again at a different sampling rate, explain how you might establish whether 
aliasing has occurred? 

(c) If aliasing occurs and the reconstructed phase is 9, find all possible values of f 0 . 

(d) If aliasing occurs but the reconstructed phase is — 9 , find all possible values of /o- 

[Hints and Suggestions: In (b), S > 2/o for no aliasing. In (c), the aliased frequency is positive 
and so, 150 = f 0 — 5007c = fo — 400 m giving X = | where k and m are chosen as integers to ensure 
fo < 2.5 kHz. In (d), start with —150 = fo — 500fc = /o — 400m.] 
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7.14 (Sampling and Aliasing) One period of a periodic signal with period T = 4 is given by x(t) = 

OO 

2fri(0.5f) — 1. The periodic signal is ideally sampled by the impulse train i(t) = S(t — k). 

k=— oo 

(a) Sketch the signals x(t) and x s (t) and confirm that xs(t ) is a periodic signal with T = 4 whose 
one period is given by x s (t ) = S(t) — S(t — 2 ), 0 < f < 4. 

(b) If x s {t) is passed through an ideal lowpass filter with a cutoff frequency of 0.6 Hz, what is the 
filter output y(t). 

OO 

(c) How do x s (t) and y(t) change if the sampling function is i(t) = 

k— —oo 

[Hints and Suggestions: For (b), xs(t) is half-wave symmetric with T — 4 and Fourier series 
coefficients A[fc] = 0.5(1 — e _:,fc7r ). For (c), Xs(t) is periodic with T = 2 and Xs(t) = (5(f), 0 < t < 2. 
Its Fourier series coefficients are X[k ] = O.5.] 

7.15 (Bandpass Sampling) The signal x(t) is band-limited to 500 Hz. The smallest frequency present in 
x(t) is /o- Find the minimum rate S at which we can sample x(t) without aliasing if 

(a) f 0 = 0. 

(b) f 0 = 300 Hz. 

(c) f 0 = 400 Hz. 

7.16 (Bandpass Sampling) A signal x(t) is band-limited to 40 Hz and modulated by a 320-Hz carrier 
to generate the modulated signal y(t). The modulated signal is processed by a square law device that 
produces g(t) = y 2 {t). 

(a) What is the minimum sampling rate for x(t) to prevent aliasing? 

(b) What is the minimum sampling rate for y(t) to prevent aliasing? 

(c) What is the minimum sampling rate for g{t) to prevent aliasing? 

7.17 (Sampling Oscilloscopes) It is required to ideally sample a signal x(t ) at S Hz and pass the 
sampled signal s(t) through an ideal lowpass filter with a cutoff frequency of O.SS' Hz such that its 
output y(t ) = x(t/a) is a stretched-by-a version of x(t). 

(a) Suppose x(t) = 1 + cos(207rf). What values of S will ensure that the output of the lowpass filter 
is y(t) = :r(0.1t). Sketch the spectra of x(t), s(t), and y(t) for the chosen value of S. 

(b) Suppose x(t) = 2cos(807rf) + cos(1607rf) and the sampling rate is chosen as S = 48 Hz. Sketch 
the spectra of x(t), s(t), and y(t). Will the output y(t) be a stretched version of x(t) with 
y(t) = x(t/a)7 If so, what will be the value of a? 

(c) Suppose x(t) = 2cos( 807rf) + cos(1007rt). What values of S will ensure that the output of the 
lowpass filter is y(t) = a;(f/20)? Sketch the spectra of x{t), s(t), and y(t) for the chosen value of 
S to confirm your results. 

[Hints and Suggestions: We require a = yyz -5 where /o is the fundamental frequency. In part (a), 
try S m = S/m (with integer m) for other choices (as long as S m > 2/ max /a).] 

7.18 (Sampling and Reconstruction) A periodic signal whose one full period is x(t) = tri(20t) is band- 
limited by an ideal analog lowpass filter whose cutoff frequency is fc■ It is then ideally sampled at 
80 Hz. The sampled signal is reconstructed using an ideal lowpass filter whose cutoff frequency is 40 
Hz to obtain the signal y(t). Find y(t) if fc = 20, 40, and 60 Hz. 
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7.19 (Sampling and Reconstruction) Sketch the spectra at the intermediate points and at the output 
of the following cascaded systems. Assume that the input is x(t) = 5sinc(5f), the sampler operates at 
S = 10 Hz and performs ideal sampling, and the cutoff frequency of the ideal lowpass filter is 5 Hz. 


(a) x(t) — 

-> sampler — 

-> ideal LPF —> y(t) 



(b) x(t) - 

-> sampler — 

—> h(t) = u(t) — u(t — 0.1) — 

—> ideal LPF - 

y(t) 


(c) x(t) —> sampler 


h(t) = u(t) — u(t — 0.1) 


ideal LPF 


mf) l = ra 


|sinc(0.1/)| 


y(t) 


[Hints and Suggestions: X(f) is a rectangular pulse. In part (a), replicate X(f). In part (b), the 
lowpass filter preserves only the central central image distorted (multiplied) by sine (f/S). In (c), the 
compensating filter removes the sine distortion.] 


7.20 (Sampling and Aliasing) The signal x(t) = e“*u(t) is sampled at a rate S such that the maximum 
aliased magnitude is less than 5% of the peak magnitude of the un-aliased image. Estimate the sampling 
rate S. 

[Hints and Suggestions: Sketch the replicated spectra and observe that the maximum aliasing occurs 
at / = 0.55. So, we require |X(0.55)| < 0.05|A(0)|.] 


7.21 (Signal Recovery) A sinusoid x(t) = sin(1507rt) is ideally sampled at 80 Hz. Describe the signal 
y(t) that is recovered if the sampled signal is passed through the following filters. 

(a) An ideal lowpass filter with cutoff frequency fc = 10 Hz 

(b) An ideal lowpass filter with cutoff frequency fc = 100 Hz 

(c) An ideal bandpass filter with a passband between 60 Hz and 80 Hz 

(d) An ideal bandpass filter with a passband between 60 Hz and 100 Hz 


[Hints and Suggestions: The spectrum of the sampled signal contains impulse pairs at ±75 Hz 
replicated every 80 Hz. Sketch this with the two-sided spectrum of each filter to obtain each output.] 

7.22 (Sampling and Aliasing) A speech signal x(t) band-limited to 4 kHz is sampled at 10 kHz to 
obtain x[n]. The sampled signal x[n] is filtered by an ideal bandpass filter whose passband extends 
over 0.03 < F < 0.3 to obtain y[n]. Will the sampled output y[n] be contaminated if x(t) also includes 
an undesired signal at the following frequencies? 


(a) 60 Hz (b) 360 Hz (c) 8.8 kHz (d) 9.8 kHz 

[Hints and Suggestions: Use the digital frequency of x[n) in the principal range.] 


7.23 (DTFT and Sampling) The transfer function of a digital filter is H(F ) = rect(2F)e l°- 57rF . 

(a) What is the impulse response h[n] of this filter? 

(b) The analog signal x(t) = cos(0.257rf) applied to the system shown. 


x{t) 


sampler 

-» 

H(F) 

-> 

ideal LPF 


y(t) 


The sampler is ideal and operates at 5 = 1 Hz. The cutoff frequency of the ideal lowpass filter 
is fc = 0.5 Hz. How are X(f) and Y(f) related? What is y{t)7 


[Hints and Suggestions: In (b), find the digital frequency of x[n\ in the principal range and use it 
to find y[n] and y(t). Then, find the Fourier transform of y(t).] 
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7.24 (Sampling and Filtering) The analog signal x(t) = cos(27r/ot) is applied to the following system: 

x(t ) —* sampler —> H(F) —> ideal LPF —> y(t) 

The sampler is ideal and operates at S = 60 Hz. The filter H(F ) describes the frequency response of 

JJ- 

a three-point averaging filter whose impulse response is h[n] = 1 { 1 , 1 , 1 }. The cutoff frequency of the 
ideal lowpass filter is fc = 40 Hz. Find y(t) if 

(a) f 0 = 20 Hz. (b) / 0 = 50 Hz. (c) /„ = 75 Hz. 

[Hints and Suggestions: Find the digital frequency of x[n] in the principal range and use it to find 
y[n\ and the reconstructed signal y(t).} 

7.25 (Sampling and Filtering) A periodic signal x(t) with period T = 0.1 s, whose Fourier series 
coefficients are given by X[k\ = 2.5sinc 2 (0.5/c), is applied to the following system: 



The prefilter band-limits the signal x(t) to B Hz. The sampler is ideal and operates at S = 80 Hz. 
The transfer function of the digital filter is H(F ) = tri(2F). The cutoff frequency of the ideal lowpass 
filter is fc = 40 Hz. Find y{t ) if 

(a) B = 20 Hz. (b) B = 40 Hz. (c) B = 80 Hz. 

[Hints and Suggestions: Find the digital frequency of each nonzero harmonic in x(t) up to B Hz in 
the principal range and use it to find the output of the digital filter and the reconstructed signal y{t ) 
(by superposition).] 

7.26 (Sampling) A speech signal band-limited to 4 kHz is ideally sampled at a sampling rate S, and the 
sampled signal x[n} is processed by the squaring filter y[n ] = x 2 [n\ whose output is ideally reconstructed 
to obtain y(t) as follows: 



What minimum sampling rate S will ensure that y(t) = x 2 {t)l 

[Hints and Suggestions: The spectrum of y[n] extends to twice the frequency of x[n\.} 

7.27 (Sampling) Consider the signal x(t) = sin(2007rt)cos(1207rf). This signal is sampled at a sampling 
rate Si, and the sampled signal x[n] is ideally reconstructed at a sampling rate S 2 to obtain y{t). What 
is the reconstructed signal if 

(a) Si = 400 Hz and S 2 = 200 Hz. 

(b) Si = 200 Hz and S 2 = 100 Hz. 

(c) Si = 120 Hz and S 2 = 120 Hz. 

[Hints and Suggestions: Use 2 sin a cos/3 = sin (a + (3) + sin(cc — 0), find the digital frequency of 

each component in the principal range, and set up the reconstructed signal (by superposition).] 

7.28 (Sampling and Filtering) A speech signal x(t) whose spectrum extends to 5 kHz is filtered by an 
ideal analog lowpass filter with a cutoff frequency of 4 kHz to obtain the filtered signal a;/(£). 

(a) If Xf(t) is to be sampled to generate y[n], what is the minimum sampling rate that will permit 
recovery of Xf(t ) from y[n]? 
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(b) If x(t) is first sampled to obtain x[n) and then digitally filtered to obtain z[n\, what must be 
the minimum sampling rate and the impulse response h[n] of the digital filter such that z[n ] is 
identical to y[n}7 

7.29 (Sampling and Filtering) The analog signal x{t) = sinc 2 (10f) is applied to the following system: 



The sampler is ideal and operates at a sampling rate S that corresponds to the Nyquist rate. The 
transfer function of the digital filter is H(F ) = rect(2F). Sketch the spectra at the output of each 
subsystem if the reconstruction is based on 

(a) An ideal analog filter whose cutoff frequency is fc = 0.5S 1 . 

(b) A zero-order-hold followed by an ideal analog filter with fc = 0.5 S. 

[Hints and Suggestions: In (a), the output is a version of X(f) truncated in frequency. In (b), the 
output will show sine distortion (due to the zero-order-hold).] 

Jf 

7.30 (Interpolation) The signal x[n] = (—1, 2, 3, 2} (with t s = Is) is passed through an interpolating 
filter. 

(a) Sketch the output if the filter performs step interpolation. 

(b) Sketch the output if the filter performs linear interpolation. 

(c) What is the interpolated value at t = 2.5 s if the filter performs sine interpolation? 

(d) What is the interpolated value at t = 2.5 s if the filter performs raised cosine interpolation 
(assume that R = 0.5)? 

[Hints and Suggestions: For (a), sketch the staircase signal. In (b), simply ’connect the dots’. For 

(c), evaluate x(t) = :r[fc]sinc(£ — fc) at f = 2.5. For (d), use the raised-cosine formula.] 

7.31 (DTFT and Sampling) A signal is reconstructed using a filter that performs step interpolation 
between samples. The reconstruction sampling interval is t s . 

(a) What is the impulse response h(t) and transfer function H(f) of the interpolating filter? 

(b) What is the transfer function Hc(f) of a filter that can compensate for the non-ideal reconstruc¬ 
tion? 

[Hints and Suggestions: For the step interpolation filter, h(t) = — u(t — t s )].] 

7.32 (DTFT and Sampling) A signal is reconstructed using a filter that performs linear interpolation 
between samples. The reconstruction sampling interval is t s . 

(a) What is the impulse response h(t) and transfer function H(f) of the interpolating filter? 

(b) What is the transfer function i?c(/) of a filter that can compensate for the non-ideal reconstruc¬ 
tion? 

[Hints and Suggestions: For the linear interpolation filter, h(t) = Atri(A).] 

7.33 (Interpolation) We wish to sample a speech signal band-limited to B = 4 kHz using zero-order-hold 
sampling. 

(a) Select the sampling frequency S if the spectral magnitude of the sampled signal at 4 kHz is to 
be within 90% of its peak magnitude. 
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(b) On recovery, the signal is filtered using a Butterworth filter with an attenuation of less than 1 dB 
in the passband and more than 30 dB for all image frequencies. Compute the total attenuation 
in decibels due to both the sampling and filtering operations at 4 kHz and 12 kHz. 

(c) What is the order of the Butterworth filter? 

[Hints and Suggestions: The zero-order-hold causes sine distortion of the form sine (f/S). For (a), 
we require sinc(B/S) > 0.9. For (b), it gives an additional attenuation of —20log |sinc(//S')|.] 

7.34 (Up-Sampling) The analog signal x(t) = 4000sinc 2 (4000f) is sampled at 12 kHz to obtain the signal 
x[n}. The sampled signal is up-sampled (zero interpolated) by N to obtain the signal y[n\ as follows: 

y M 

Sketch the spectra of X(F) and Y(F) over — 1 < F < 1 for N = 2 and N = 3. 

[Hints and Suggestions: After up-sampling by N, there are N compressed images per period (cen¬ 
tered at F = j|).] 

7.35 (Up-Sampling) The signal x[n] is up-sampled (zero interpolated) by N to obtain the signal y [n]. 
Sketch X(F) and Y(F) over — 1 < F < 1 for the following cases. 

(a) a;[n] = sinc(0.4n), N = 2 

(b) X(F) =tri(4 F), N = 2 

(c) X(F) =tri(6 F), N = 3 

[Hints and Suggestions: After up-sampling by N, there are N compressed images per period (cen¬ 
tered at F = )|).] 

7.36 (Linear Interpolation) Consider a system that performs linear interpolation by a factor of N. One 
way to construct such a system is to perform up-sampling by N (zero interpolation between signal 
samples) and pass the up-sampled signal through an interpolating filter with impulse response h[n] 
whose output is the linearly interpolated signal y[n] as shown. 

y[n] 

(a) What impulse response h[n] will result in linear interpolation by a factor of N = 2? 

(b) Sketch the frequency response H(F) of the interpolating filter for N = 2. 

(c) Let the input to the system be X(F) = rect(2F). Sketch the spectrum at the output of the 
up-sampler and the interpolating filter. 

[Hints and Suggestions: In (a), linear interpolation requires h[n\ = tri (n/N). In (c), there are N 
compressed images per period after up-sampling (centered at F = Yy The digital filter removes any 
images outside |Fc|.] 

7.37 (Interpolation) The input x[n\ is applied to a system that up-samples by N followed by an ideal 
lowpass filter with a cutoff frequency of Fq to generate the output y [n]. Draw a block diagram of the 
system. Sketch the spectra at various points of this system and find y[n\ and Y(F) for the following 
cases. 

(a) x[n] = sinc(0.4n), N = 2, Fc = 0.4 

(b) X{F) = tri(4F), N = 2, F c = 0.375 


up-sample | N 


filter h[n] 


up-sample | AT 
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[Hints and Suggestions: After up-sampling by N, there are N compressed images per period (cen¬ 
tered at F = A). The digital filter removes any images outside \Fc\-] 

7.38 (Decimation) The signal x(t) = 2cos(1007rf) is ideally sampled at 400 Hz to obtain the signal x[n], 
and the sampled signal is decimated by N to obtain the signal y[n}. Sketch the spectra X(F) and 
Y(F ) over — 1 < F < 1 for the cases N = 2 and N = 3. 

[Hints and Suggestions: In decimation by N, the images are stretched by N, amplitude scaled by 
A and added (where overlap exists).] 

7.39 (Decimation) The signal x[n] is decimated by N to obtain the decimated signal y[n\. Sketch X(F) 
and Y(F) over — 1 < F < 1 for the following cases. 

(a) x[n] = sinc(0.4n), N = 2 

(b) X(F) =tri(4 F), N = 2 

(c) X(F) =tri(3 F), N = 2 


[Hints and Suggestions: In decimation by N, the images are stretched by N, amplitude scaled by 
jj and added (where overlap exists).] 


7.40 (Interpolation and Decimation) Consider the following system: 


up-sample | XT 

- » 

digital LPF 

- > 

down-sample | M 


y[r 


The signal x[n\ is up-sampled (zero-interpolated) by N = 2, the digital lowpass filter is ideal and has 
a cutoff frequency of Fc, and down-sampling is by M = 3. Sketch X(F) and Y(F) and explain how 
they are related for the following cases. 


(a) X(F) = tri(4 F) and F c = 0.125 (b) X(F) = tri(2 F) and F c = 0.25 


[Hints and Suggestions: After up-sampling by N, there are N compressed images per period (cen¬ 
tered at F = A). The digital filter removes any images outside Fc \. In down-sampling by M, the 
images are stretched by M, amplitude scaled by and added (where overlap exists).] 


7.41 


(Interpolation and Decimation) For each of the following systems, X(F) = tri(4 F). The digital 
lowpass filter is ideal and has a cutoff frequency of Fc = 0.25 and a gain of 2. Sketch the spectra at 
the various points over — 1 < F < 1 and determine whether any systems produce identical outputs. 


( a ) 

(b) 

(c) 


x[n] 

x[n] 

x[n] 


up-sample | N = 2 —> digital LPF —> clown-sample [ M = 2 

down-sample ] M = 2 

-» 

-» 

digital LPF —> up-sample f TV = 2 

down-sample [ M = 2 

up-sample ] N = 2 —> digital LPF 


y[n ] 
y[n] 
y[n\ 


[Hints and Suggestions: After up-sampling by N, there are N compressed images per period (cen¬ 
tered at F = jj). The digital filter removes any images outside Fc \. In down-sampling by M, the 
images are stretched by M, amplitude scaled by and added (where overlap exists).] 


7.42 


(Interpolation and Decimation) For each of the following systems, X(F) = tri(3F 1 ). The digital 
lowpass filter is ideal and has a cutoff frequency of Fc = | and a gain of 2. Sketch the spectra at the 
various points over — 1 < F < 1 and determine whether any systems produce identical outputs. 


( a ) 

(b) 

(c) 


x[n] 

x[n\ 

x[n] 


up-sample | N = 2 —> digital LPF —> down-sample J. M = 2 

down-sample [ M = 2 

- > 

-> 

digital LPF —> up-sample j TV = 2 

clown-sample J. M = 2 

up-sample | N = 2 —> digital LPF 


y[n] 

y[n] 

y[n] 
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[Hints and Suggestions: After up-sampling by N, there are N compressed images per period (cen¬ 
tered at F = jj). The digital filter removes any images outside |Fc|. In down-sampling by M, the 
images are stretched by M, amplitude scaled by jj and added (where overlap exists).] 

7.43 (Interpolation and Decimation) You are asked to investigate the claim that interpolation by N 
and decimation by N performed in any order, as shown, will recover the original signal. 


Method 1: 


x\n\ 


up-sample f N 


digital LPF 


down-sample J, N 


y M 


Method 2: x[n] 


down-sample J, N 


up-sample f N 


digital LPF 


y M 


(a) Let X(F) = tri(4F) and N = 2. Let the lowpass filter have a cutoff frequency of Fq = 0.25 and 
a gain of 2. Sketch the spectra over — 1 < F < 1 at the various points. For which method does 
■y[n] equal x[n}? Do the results justify the claim? 

(b) Let X(F) = tri(3F) and N = 2. Let the lowpass filter have a cutoff frequency of Fq = (r and 
a gain of 2. Sketch the spectra over — 1 < F < 1 at the various points. For which method does 
■y[n\ equal x[n\? Do the results justify the claim? 

(c) Are any restrictions necessary on the input for x[n] to equal y[n] in each method? Explain. 


[Hints and Suggestions: After up-sampling by N, there are N compressed images per period (cen¬ 
tered at F = jj). The digital filter removes any images outside Fq\■ In down-sampling by M, the 
images are stretched by M, amplitude scaled by jj and added (where overlap exists).] 


7.44 (Fractional Delay) The following system is claimed to implement a half-sample delay: 


c(t) 


sampler 

-» 

H(F) 

-> 

ideal LPF 


y(t ) 


The signal x(t) is band-limited to fc, and the sampler is ideal and operates at the Nyquist rate. The 
digital filter is described by H\{F) = e~^ F , |F| < Fc, and the cutoff frequency of the ideal lowpass 
filter is fc- 


(a) Sketch the magnitude and phase spectra at the various points in this system. 

(b) Show that y(t) = x(t — 0.5t s ) (corresponding to a half-sample delay). 


7.45 (Fractional Delay) In practice, the signal y[n\ = x[n — 0.5] may be generated from x[n] using 
interpolation by 2 (to give a:[0.5n]) followed by a one-sample delay (to give x[0.5(n —1)]) and decimation 
by 2 (to give x[n — 0.5]). This is implemented as follows: 


up-sample | 2 

-* 

ideal LPF 

-» 

1 -sample delay 

-> 

clown-sample j 2 


(a) Let X(F) = tri(4F). Sketch the magnitude and phase spectra at the various points. 

(b) What should be the gain and the cutoff frequency of the ideal lowpass filter if y[n] = x[n — 0.5] 
or Y(F) = X{F)e~^ F (implying a half-sample delay). 


[Hints and Suggestions: Up-sampling by N gives N compressed images per period (centered at F = 
jj). The digital filter removes images outside |Fc|. The delay adds the linear phase —27 tF, |F| < Fc■ 
In down-sampling by M, the images are stretched by M, amplitude scaled by .] 

7.46 (Quantization SNR) Consider the signal x(t) = t 2 , 0 < t < 2. Choose t s = 0.1 s, four quantization 
levels, and rounding to find the following: 

(a) The sampled signal x[n] 
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(b) The quantized signal xq[ti ] 

(c) The actual quantization signal to noise ratio SNRq 

(d) The statistical estimate of the quantization SNR 5 

(e) An estimate of the SNR, assuming x(t) to be periodic, with period T = 2 s 

[Hints and Suggestions: For (e), use Ps = ^ Jq t 4 dt to estimate the SNR.] 

7.47 (Quantization SNR) A sinusoid with a peak value of 4 V is sampled and then quantized by a 12-bit 
quantizer whose full-scale range is ±5 V. What is the quantization SNR of the quantized signal? 

[Hints and Suggestions: The dynamic range is D = 10 V and the signal power is Ps = 0.5(4) 2 .] 

7.48 (Quantization Noise Power) The quantization noise power based on quantization by rounding is 
a 2 = A 2 /12, where A is the quantization step size. Find an expression for the quantization noise 
power based on 

(a) Quantization by truncation. 

(b) Quantization by sign-magnitude truncation. 

[Hints and Suggestions: For part (a), the error is equally distributed between —A and 0, and so 
/(e) = —A < e < 0 with mean m = —0.5A. For part (b), the error is equally distributed between 
—A and A, and so /(e) = A, —A < e < A with mean m = 0.] 

7.49 (Sampling and Quantization) A sinusoid with amplitude levels of ±1 V is quantized by rounding, 
using a 12-bit quantizer. What is the rms quantization error and the quantization SNR? 

[Hints and Suggestions: With A = t//, the quantization error is a = ^ 7 =-] 

7.50 (Anti-Aliasing Filters) A speech signal is to be band-limited using an anti-aliasing third-order 
Butterworth filter with a half-power frequency of 4 kHz, and then sampled and quantized by an 8 -bit 
quantizer. Determine the minimum stopband attenuation and the corresponding stopband frequency 
to ensure that the maximum stopband aliasing level (relative to the passband edge) is less than the 
rms quantization error. 

[Hints and Suggestions: The attenuation is A s = 201og(2 s \/6) = 101og(l + zA") with u s = f s /f P -\ 

7.51 (Anti-Aliasing Filters) A noise-like signal with a flat magnitude spectrum is filtered using a third- 
order Butterworth filter with a half-power frequency of 3 kHz, and the filtered signal is sampled at 
10 kHz. What is the aliasing level (relative to the signal level) at the half-power frequency in the 
sampled signal? 

[Hints and Suggestions: The signal level at the passband edge (half-power frequency) is 0.707. The 
aliasing level at the passband edge is (1 + jA")- 1 / 2 with v = (S — f p )/f p -] 

7.52 (Anti-Aliasing Filters) A speech signal with amplitude levels of ±1 V is to be band-limited using an 
anti-aliasing second-order Butterworth filter with a half-power frequency of 4 kHz, and then sampled 
and quantized by an 8 -bit quantizer. What minimum sampling rate S will ensure that the maximum 
aliasing error at the passband edge is less than the rms quantization level? 

[Hints and Suggestions: With Vfs = 2, find A = Vfs/2 b and the quantization noise level A/y/l2. 
The aliasing level at the passband edge is (1 + v 2n )~ 1 / 2 with v = (S — f p )/f p ] 
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7.53 (Sampling and Quantization) The signal x(t) = 2 cos(20007rf) — 4sin(40007rf) is quantized by 
rounding, using a 12-bit quantizer. What is the rms quantization error and the quantization SNR? 

[Hints and Suggestions: The signal power is Ps = 0.5(2 2 + 4 2 ). The peak value cannot exceed 6 , 
so choose D = 12 (or twice the actual peak value).] 

7.54 (Sampling and Quantization) A speech signal, band-limited to 4 kHz, is to be sampled and 
quantized by rounding, using an 8 -bit quantizer. What is the conversion time of the quantizer if it is 
preceded by a sample-and-hold circuit with an aperture time of 20 ns and an acquisition time of 2 /zs? 
Assume sampling at the Nyquist rate. 

[Hints and Suggestions: Use S < t a +t u +t c ■] 

7.55 (Sampling and Quantization) A 10-kHz sinusoid with amplitude levels of ±1 V is to be sampled 
and quantized by rounding. How many bits are required to ensure a quantization SNR of 45 dB? What 
is the bit rate (number of bits per second) of the digitized signal if the sampling rate is chosen as twice 
the Nyquist rate? 

[Hints and Suggestions: The signal power is Ps = 0.5. The noise power is A 2 /12 where A = 2/2 s . 
The SNR equals 10 \og{Ps / Pn)- The bit rate equals SB bits/second.] 

7.56 (Anti-Imaging Filters) A digitized speech signal, band-limited to 4 kHz, is to be reconstructed 
using a zero-order-hold. What minimum reconstruction sampling rate will ensure that the signal level 
in the passbancl is attenuated by less than 1.2 dB due to the sine distortion of the zero-order-hold? 
What will be the image rejection at the stopband edge? 

[Hints and Suggestions: The sine distortion is sine (f/S). So, 20log |sinc(/ p /S')| = —1.2. To find S, 
you will need to find a way to compute the inverse sine!] 

7.57 (Anti-Imaging Filters) A digitized speech signal, band-limited to 4 kHz, is to be reconstructed using 
a zero-order-hold followed by an analog Butterworth lowpass filter. The signal level in the passband 
should be attenuated less than 1.5 dB, and an image rejection of better than 45 dB in the stopband is 
required. What are the specifications for the Butterworth filter if the reconstruction sampling rate is 
16 kHz? What is the order of the Butterworth filter? 

[Hints and Suggestions: Assume f s = S — f p and subtract the attenuations —20 log |sinc(/ p /S')| and 
—20 log |sine(/,/S') | due to sine distortion from the given values to find the filter specifications.] 

7.58 (Anti-Aliasing and Anti-Imaging Filters) A speech signal is to be band-limited using an anti¬ 
aliasing Butterworth filter with a half-power frequency of 4 kHz. The sampling frequency is 20 kHz. 
What filter order will ensure that the in-band aliasing level is be less 1% of the signal level? The 
processed signal is to be reconstructed using a zero-order-hold. What is the stopband attenuation 
required of an anti-imaging filter to ensure image rejection of better than 50 dB? 

[Hints and Suggestions: The signal level at the half-power frequency is 0.707. The aliasing level 
at the passband edge is (1 + i / 2 ") -1 / 2 with v = (S — f p )/f p - Find the filter order n and subtract the 
attenuation due to sine distortion from 50 dB to set the filter stopband attenuation.] 


COMPUTATION AND DESIGN 


7.59 (Interpolating Functions) Consider the signal x(t) = cos(0.57rt) sampled at S = 1 Hz to generate 
the sampled signal x[n\. We wish to compute the value of x(t) at t = 0.5 by interpolating between its 
samples. 
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Superimpose a plot of x(t) and its samples x[n] over one period. What is the value of x{t) 
predicted by step interpolation and linear interpolation of x[n \? How good are these estimates? 
Can these estimates be improved by taking more signal samples (using the same interpolation 
schemes)? 

Use the sine interpolation formula 

OO 

*(*) = y a;[n]sinc[(f — nt s )/t s \ 

71 — — OO 

to obtain an estimate of :r(0.5). With t = 0.5 and t s = 1/S = 1, compute the summation for 
|n| < 10, 20, 50 to generate three estimates of x(0.5). How good are these estimates? Would you 
expect the estimate to converge to the actual value as more terms are included in the summation 
(i.e., as more signal samples are included)? Compare the advantages and disadvantages of sine 
interpolation with the schemes in part (a). 

7.60 (Interpolating Functions) To interpolate a signal x[n\ by TV, we use an up-sampler (that places 
TV —1 zeros after each sample) followed by a filter that performs the appropriate interpolation as shown: 


The filter impulse response for step interpolation, linear interpolation, and ideal (sine) interpolation is 

hs[n\ = u[n] — u[n — (N — 1)] = tri(n/iV) hi[n] = sine(n/TV), \n\ < M 

Note that the ideal interpolating function is actually of infinite length but must be truncated in practice. 
Generate the test signal x[n] = cos(0.5?r7r), 0 < n < 3. Up-sample this by TV = 8 (seven zeros after 
each sample) to obtain the signal Xjj[n}. Use the Matlab routine filter to filter Xjj[n], using 

(a) The step interpolation filter to obtain the filtered signal £s[?r]. Plot xu[n] and a;s[n] on the same 
plot. Does the system perform the required interpolation? Does the result look like a sine wave? 

(b) The linear interpolation filter to obtain the filtered signal XL[n). Plot xu[n ] and a delayed (by 
8 ) version of Xl[u} (to account for the noncausal nature of Til[ti]) on the same plot. Does the 
system perform the required interpolation? Does the result look like a sine wave? 

(c) The ideal interpolation filter (with M = 4, 8, 16) to obtain the filtered signal x; [n]. Plot xu[n} 
and a delayed (by M) version of xi[n ] (to account for the noncausal nature of hi[n ]) on the same 
plot. Does the system perform the required interpolation? Does the result look like a sine wave? 
What is the effect of increasing M on the interpolated signal? What is the effect of increasing 
both M and the signal length? Explain. 

7.61 (Compensating Filters) Digital filters are often used to compensate for the sine distortion of a 
zero-order-hold DAC by providing a l/sinc(F) boost. Two such filters are described by 

Compensating Filter 1: y[n] = — 18a;[n — 1] + x[n — 2]) 

Compensating Filter 2: y[n] + \y[n — 1] = | x[n] 

(a) For each filter, state whether it is FIR (and if so, linear phase) or HR. 

(b) Plot the frequency response of each filter and compare with |l/sinc(F)|. 

(c) Over what digital frequency range does each filter provide the required sine boost? Which of 
these filters provides better compensation? 

7.62 (Up-Sampling and Decimation) Let x[n] = cos(0.2n7r) + 0.5 cos(0.4?r7r), 0 < n < 100. 


x\n\ 


up-sample f TV 


interpolating filter 


y[n] 


( a ) 

(b) 
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(a) Plot the spectrum of this signal. 

(b) Generate the zero-interpolated signal y[n] = x[n/ 2] and plot its spectrum. Can you observe the 
spectrum replication? Is there a correspondence between the frequencies in y[n\ and x[n\7 Should 
there be? Explain. 

(c) Generate the decimated signal d[n\ = x[2n] and plot its spectrum. Can you observe the stretching 
effect in the spectrum? Is there a correspondence between the frequencies in d[n] and x[n]l Should 
there be? Explain. 

(d) Generate the decimated signal g[n] = x[2>n] and plot its spectrum. Can you observe the stretching 
effect in the spectrum? Is there a correspondence between the frequencies in g[n] and x[n]l Should 
there be? Explain. 

7.63 (Frequency Response of Interpolating Functions) The impulse response of filters for step in¬ 
terpolation, linear interpolation, and ideal (sine) interpolation by TV are given by 

hs[ n ] = u[n] — u[n — (TV — 1)] h L [n] = tn(n/N) hj[n] = sinc(n/TV) 

Note that the ideal interpolating function is of infinite length. 

(a) Plot the frequency response of each interpolating function for TV = 4 and TV = 8. 

(b) How does the response of the step-interpolation and linear-interpolation schemes compare with 
ideal interpolation? 

7.64 (Interpolating Functions) To interpolate a signal x[n\ by TV, we use an up-sampler (that places 
TV — 1 zeros after each sample) followed by a filter that performs the appropriate interpolation. The 
filter impulse response for step interpolation, linear interpolation, and ideal (sine) interpolation is 
chosen as 

hs[n] = u[n\ — u[n — (TV — 1)] TilN = tri(n/TV) hi[n\ = sine(n/TV), |?r| < M 

Note that the ideal interpolating function is actually of infinite length and must be truncated in 
practice. Generate the test signal x[n] = cos(0.5wr), 0 < n < 3. Up-sample this by TV = 8 (seven 
zeros after each sample) to obtain the signal xu[n\. Use the Matlab routine filter to filter Xjj [n] as 
follows: 

(a) Use the step-interpolation filter to obtain the filtered signal xs[ri}. Plot Xu[n] and £s[?r] on the 
same plot. Does the system perform the required interpolation? Does the result look like a sine 
wave? 

(b) Use the step-interpolation filter followed by the compensating filter y[n] = {x[n\ — 18x[n — 1] + 
x[n — 2]}/16 to obtain the filtered signal xc[n]. Plot Xu[n\ and xc[n ] on the same plot. Does 
the system perform the required interpolation? Does the result look like a sine wave? Is there 
an improvement compared to part (a)? 

(c) Use the linear-interpolation filter to obtain the filtered signal XL[n\. Plot Xu[n] and a delayed 
(by 8) version of x^[n] (to account for the noncausal nature of Tizjrc]) on the same plot. Does the 
system perform the required interpolation? Does the result look like a sine wave? 

(d) Use the ideal interpolation filter (with M = 4, 8, 16) to obtain the filtered signal xj[n]. Plot 
xjj[n] and a delayed (by M) version of xj [n] (to account for the noncausal nature of hj[n}) on 
the same plot. Does the system perform the required interpolation? Does the result look like a 
sine wave? What is the effect of increasing M on the interpolated signal? Explain. 

7.65 (FIR Filter Design) A 22.5-Hz sinusoid is contaminated by 60-Hz interference. We wish to sample 
this signal and design a causal 3-point linear-phase FIR digital filter operating at a sampling frequency 
of S = 180 Hz to eliminate the interference and pass the desired signal with unit gain. 
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jj. 

(a) Argue that an impulse response of the form h[n] = {a, (3 , a} can be used. Choose a and j3 to 
satisfy the design requirements. 

(b) To test your filter, generate two signals x[n] and s[n], 0 < n < 50, by sampling x(t) = cos(457rf) 
and s(t) = 3cos(1207rf) at 180 Hz. Generate the noisy signal g[n\ = x[n\ + s[n] and pass it 
through your filter to obtain the filtered signal y[n]. Compare y[n] with the noisy signal g[n] and 
the desired signal x[n\ to confirm that the filter meets design requirements. What is the phase 
of y[n] at the desired frequency? Can you find an exact expression for y[n\7 

7.66 (Sampling and Quantization) The signal x(t ) = cos(27rf) + cos(67rf) is sampled at S = 20 Hz. 

(a) Generate 200 samples of x[n ] and superimpose plots of x(t) vs. t and x[n] vs. n/S. Use a Tbit 
quantizer to quantize x[n] by rounding and obtain the signal xr[ti]. Superimpose plots of x(t) 
vs. t and Xn[n ] vs. n/S. Obtain the quantization error signal e[n ] = x[n] — xn[n] and plot e[n] 
and its 10-bin histogram. Does it show a uniform distribution? Compute the quantization SNR 
in decibels. Repeat for 800 samples. Does an increase in the signal length improve the SNR? 

(b) Generate 200 samples of x[n] and superimpose plots of x(t) vs. t and x[n} vs. n/S. Use an 8-bit 
quantizer to quantize x[n\ by rounding and obtain the signal x[n]. Superimpose plots of x(t ) 
vs. t and Xn[n] vs. n/S. Obtain the quantization error signal e[n] = x[n] — xn[n] and plot e[n] 
and its 10-bin histogram. Compute the quantization SNR in decibels. Compare the quantization 
error, the histogram, and the quantization SNR for the 8-bit and Tbit quantizer and comment 
on any differences. Repeat for 800 samples. Does an increase in the signal length improve the 
SNR? 

(c) Based on your knowledge of the signal x(t), compute the theoretical SNR for a Tbit and 8-bit 
quantizer. How does the theoretical value compare with the quantization SNR obtained in parts 
(a) and (b)? 

(d) Repeat parts (a) and (b), using quantization by truncation of x[n}. How does the quantization 
SNR for truncation compare with the the quantization SNR for rounding? 

7.67 (LORAN) A LORAN (long-range radio and navigation) system for establishing positions of marine 
craft uses three transmitters that send out short bursts (10 cycles) of 100-kHz signals in a precise phase 
relationship. Using phase comparison, a receiver (on the craft) can establish the position (latitude and 
longitude) of the craft to within a few hundred meters. Suppose the LORAN signal is to be digitally 
processed by first sampling it at 500 kHz and filtering the sampled signal using a second-order peaking 
filter with a half-power bandwidth of 1 kHz. Design the peaking filter and use Matlab to plot its 
frequency response. 

7.68 (Plucked-String Filters) Figure P7.68 shows three variants of the Karplus-Strong filter for synthe¬ 
sizing plucked-string instruments. Assume that Glp(z) = 0.5(1 + z -1 ). 



Figure P7.68 Plucked-string filters for Problem 7.68 


(a) Find the transfer function of each circuit. 

(b) Plot the frequency response of each filter for D = 12 (choose an appropriate value for A). 

(c) Describe the differences in the frequency response and impulse response of each filter. 
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7.69 (Plucked-String Filters) We wish to use the Karplus-Strong filter to synthesize a guitar note 
played at exactly 880 Hz, using a sampling frequency of 10 kHz, by including a first-order allpass filter 
Gap (z) = (l + az)/{z + a) in the feedback loop. Choose the second variant from the previous problem 
and assume that Glp(z) = 0.5(1 + z -1 ). 

(a) What is the value of D and the value of the allpass parameter a? 

(b) Plot the frequency response of the designed filter, using an appropriate value for A. 

(c) How far off is the fundamental frequency of the designed filter from 880 Hz? 

(d) Show that the exact relation for finding the parameter a from the phase delay t p at any frequency 
is given by 

sin[(l — fpVFl 

(y — --- 

sin[(l + t p )nF] 

(e) Use the result of part (d) to compute the exact value of a at the digital frequency corresponding 
to 880 Hz and plot the frequency response of the designed filter. Is the fundamental frequency 
of the designed filter any closer to 880 Hz? Will the exact value of a be more useful for lower or 
higher sampling rates? 

7.70 (Generating DTMF Tones) In dual-tone multi-frequency (DTMF) or touch-tone telephone dialing, 
each number is represented by a dual-frequency tone (as described in the text). It is required to generate 
the signal at each frequency as a pure cosine, using a digital oscillator operating at a sampling rate of 
S = 8192 Hz. By varying the parameters of the digital filter, it should be possible to generate a signal 
at any of the required frequencies. A DTMF tone can then be generated by adding the appropriate 
low-frequency and high-frequency signals. 

(a) Design the digital oscillator and use it to generate tones corresponding to all the digits. Each 
tone should last for 0.1 s. 

(b) Use the FFT to obtain the spectrum of each tone and confirm that its frequencies correspond to 
the appropriate digit. 

7.71 (Decoding DTMF Tones) To decode a DTMF signal, we must be able to isolate the tones and 
then identify the digits corresponding to each tone. This may be accomplished in two ways: using the 
FFT or by direct filtering. 

(a) Generate DTMF tones (by any method) at a sampling rate of 8192 Hz. 

(b) For each tone, use the FFT to obtain the spectrum and devise a test that would allow you to 
identify the digit from the frequencies present in its FFT. How would you automate the decoding 
process for an arbitrary DTMF signal? 

(c) Apply each tone to a parallel bank of bandpass (peaking) filters, compute the output signal energy, 
compare with an appropriate threshold to establish the presence or absence of a frequency, and 
relate this information to the corresponding digit. You will need to design eight peaking filters 
(centered at the appropriate frequencies) to identify the frequencies present and the corresponding 
digit. How would you automate the decoding process for an arbitrary DTMF signal? 
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8.0 Scope and Objectives 

FIR filters are always stable and can be designed with linear phase, and hence no phase distortion. Their 
design is typically based on selecting a symmetric impulse response sequence whose length is chosen to meet 
design specifications. For given specifications, FIR filters require many more elements in their realization 
than do HR filters. This chapter starts with an introduction to filter design. It describes symmetric sequences 
and their application to FIR filters. It examines various methods of FIR filter design, including the window 
method and frequency sampling. It concludes with special-purpose FIR filters such as differentiators and 
Hilbert transformers, and an introduction to adaptive signal processing. 


8.1 Introduction 

Digital filters process discrete-time signals. They are essentially mathematical implementations of a filter 
equation in software or hardware. They suffer from few limitations. Among their many advantages are 
high noise immunity, high accuracy (limited only by the roundoff error in the computer arithmetic), easy 
modification of filter characteristics, freedom from component variations, and, of course, low and constantly 
decreasing cost. Digital filters are therefore rapidly replacing analog filters in many applications where they 
can be used effectively. The term digital altering is to be understood in its broadest sense, not only as a 
smoothing or averaging operation, but also as any processing of the input signal. 

8.1.1 The Design Process 

A filter may be regarded as a frequency-selective device that allows us to shape the magnitude or phase 
response in a prescribed manner. We concentrate on the design of lowpass filters because it can easily be 
converted to other forms by suitable frequency transformations. Typical magnitude (or gain) specifications 
for a lowpass digital filter are illustrated in Figure 8.1 and include the passband and stopband frequencies, 
the passband attenuation (or gain or ripple), and the stopband attenuation (or gain or ripple). The passband 
ripple (deviation from maximum gain) and stopband ripple (deviation from zero gain) are usually described 
by their attenuation (reciprocal of the linear gain) expressed in decibels. 


| REVIEW PANEL 8.1 | 

How Are the Gain and Attenuation Related on a Linear or Decibel Scale? 

Linear: Attenuation equals the reciprocal of gain: G=\H(f)\, A=l/\H(f)\. 

Decibel: Attenuation equals the negative of dB gain: GdB = 20log A^b = —20log \H(f)\. 
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Figure 8.1 The features of a typical lowpass digital filter 


If analog frequencies are specified in the design or if the digital filter is to be designed for processing 
sampled analog signals, the sampling rate must also be given. The design process is essentially a three-step 
process that requires specification of the design parameters, design of the least complex transfer function 
that meets or beats the design specifications, and realization of the transfer function in software or hardware. 
The design based on any set of performance specifications is, at best, a compromise at all three levels. At 
the first level, the actual filter may never meet performance specifications if they are too stringent; at the 
second, the same set of specifications may lead to several possible realizations; and at the third, quantization 
and roundoff errors may render the design useless if based on too critical a set of design values. The fewer 
or less stringent the specifications, the better is the possibility of achieving both design objectives and 
implementation. 

8.1.2 Techniques of Digital Filter Design 

Digital filter design revolves around two distinctly different approaches. If linear phase is not critical, HR 
filters yield a much smaller filter order for a given application. Only FIR filters can be designed with linear 
phase (no phase distortion). Their design is typically based on selecting a symmetric impulse response 
sequence whose length is chosen to meet design specifications. This choice is often based on iterative 
techniques or trial and error. For given specifications, FIR filters require many more elements in their 
realization than do HR filters. 


8.2 Symmetric Sequences and Linear Phase 

Symmetric sequences possess linear phase and result in a constant delay with no amplitude distortion. This 
is an important consideration in filter design. The DTFT of a real, even symmetric sequence x[n] is of 
the form H(F) = A(F ) and always real, and the DTFT of a real, odd symmetric sequence is of the form 
H(F) = jA{F) and purely imaginary. Symmetric sequences also imply noncausal filters. However, such 
filters can be made causal if the impulse response is suitably delayed. A time shift of x[n] to x[n — M) 
introduces only a linear phase of <f>(F ) = e _:,2M7rF . The DTFT of sequences that are symmetric about their 
midpoint is said to possess generalized linear phase. Generalized linear phase is illustrated in Figure 8.2. 

The term generalized means that 4>(F ) may include a jump (of tt at F = 0, if H(F) is imaginary). There 
may also be phase jumps of 2-7T (if the phase is restricted to the principal range n < <j>(F) < n). If we plot 
the magnitude \H(F)\, there will also be phase jumps of tt (where the amplitude A(F) changes sign). 


| REVIEW PANEL 8.2 

Linear-Phase Filters Provide a Constant Group Delay 
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Figure 8.2 Examples of linear phase and generalized linear phase 


8.2.1 Classification of Linear-Phase Sequences 

The length TV of finite symmetric sequences can be odd or even, since the center of symmetry may fall on 
a sample point (for odd TV ) or midway between samples (for even TV). This results in four possible types of 
symmetric sequences. 

Type 1 Sequences 

A type 1 sequence h-\ [n] and its amplitude spectrum Ai(F) are illustrated in Figure 8.3. 

Type 1 Odd length 
j Even symmetry 

<=> 

-1 -0.5 0.5 1 

Center of symmetry Even symmetry about F = 0 and F = 0.5 

Figure 8.3 Features of a type 1 symmetric sequence 

This sequence is even symmetric with odd length TV, and a center of symmetry at the integer value 
M = (TV — l)/2. Using Euler’s relation, its frequency response H\{F) may be expressed as 


Type 11 A(F) 



H\{F) 


M—l 

h[M} + 2J2 h[k]cos[(M - k)2nF} 
k=0 


—j2TrMF 

e J 


A 1 (F)e -j27rMF 


( 8 . 1 ) 


Thus, Hi(F) shows a linear phase of —2nMF, and a constant group delay of M. The amplitude spectrum 
A\(F) is even symmetric about both F — 0 and F = 0.5, and both |ffi(0)| and |Hi(0.5)| can be nonzero. 


Type 2 Sequences 

A type 2 sequence h 2 [n\ and its amplitude spectrum A 2 (F) are illustrated in Figure 8.4. 

This sequence is also even symmetric but of even length TV, and a center of symmetry at the half-integer 
value TVf = (TV — l)/2. Using Euler’s relation, its frequency response H 2 (F) may be expressed as 


H 2 {F) 


M- 1/2 

2 ^ h[k]cos[(M — k)2irF] 
fc=o 


—j2itMF 

e J 


A 2 {F)e~^ MF 


( 8 . 2 ) 
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Type 2 Even length 



Center of svmmetrv 


Figure 8.4 Features of a type 2 symmetric sequence 


Thus, H 2 {F) also shows a linear phase of —2nMF, and a constant group delay of M. The amplitude 
spectrum A 3 (F) is even symmetric about F = 0, and odd symmetric about F = 0.5, and as a result, |^ 2 (0.5)| 
is always zero. 

Type 3 Sequences 

A type 3 sequence h 3 [n] and its amplitude spectrum A 3 (F ) are illustrated in Figure 8.5. 


Type 3 Odd length 



Figure 8.5 Features of a type 3 symmetric sequence 


This sequence is odd symmetric with odd length N, and a center of symmetry at the integer value 
M = (N — l)/2. Using Euler’s relation, its frequency response H 3 (F ) may be expressed as 

" M—l 

H 3 (F) = j 2 ^ h[k]sin[(M — fc)27rF] 

. k =0 

Thus, H 3 (F) shows a generalized linear phase of \ — 2ttMF, and a constant group delay of M. The amplitude 
spectrum A 3 (F) is odd symmetric about both F = 0 and F = 0.5, and as a result, |7T 3 (0)| and \H 3 (0.5)\ are 
always zero. 

Type 4 Sequences 

A type 4 sequence / 14 [n] and its amplitude spectrum A±(F) are illustrated in Figure 8 . 6 . 

This sequence is odd symmetric with even length N, and a center of symmetry at the half-integer value 
M = ( N — l)/2. Using Euler’s relation, its frequency response H 3 (F) may be expressed as 

M- 1/2 

H±(F) = j 2 h[k]sin[2(M — k)nF] 
k =0 


e -F” MF = A 4 (F)e^°- 5,r - 27rMF) (8.4) 


e -j2irMF = A ^ e j(0.5n-2nMF) ( 8 . 3 ) 
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Type 4 Even length 


Odd symmetry 

Type 4 

A(F) A( 0) = 0 

1 f 

» <^=> 

-1 -Q.5 

/ 

1 1 

V _ ) 

0.5 1 ’ 

T \ 


V/" "X-/ 


1 Center of 

Odd symmetry about F = 0 


l symmetry 

Figure 8.6 Features of a type 4 symmetric sequence 


Thus, Hi(F~) also shows a generalized linear phase of ^ — 2i tMF, and a constant group delay of M. The 
amplitude spectrum A^F) is odd symmetric about F = 0, and even symmetric about F = 0.5, and as a 
result, 11 / 4 ( 0 ) | is always zero. 


8.2.2 Applications of Linear-Phase Sequences 

Table 8.1 summarizes the amplitude response characteristics of the four types of linear-phase sequences and 
their use in FIR digital filter design. Type 1 sequences are by far the most widely used because they allow 
us to design any filter type by appropriate choice of filter coefficients. Type 2 sequences can be used for 
lowpass and bandpass filters, but not for bandstop or highpass filters (whose response is not zero at F = 0.5). 
Type 3 sequences are useful primarily for bandpass filters, differentiators, and Hilbert transformers. Type 4 
sequences are suitable for highpass or bandpass filters, and for differentiators and Hilbert transformers. 

Bandstop filters (whose response is nonzero at F = 0 and F = 0.5) can be designed only with type 1 
sequences. Only antisymmetric sequences (whose transfer function is imaginary) or their causal versions 
(which correspond to type 3 and type 4 sequences) can be used to design digital differentiators and Hilbert 
transformers. 


Table 8.1 Applications of Symmetric Sequences 


Type 

H(F) = 0 (or H{n) = 0) at 

Application 

1 


All filter types. Only sequence for BSF 

2 

F = 0.5 (fi = 7r) 

Only LPF and BPF 

3 

F = 0 (0 = 0), F = 0.5 (f2 = 7r) 

BPF, differentiators, Hilbert transformers 

4 

II 

o 

3 

II 

HPF, BPF, differentiators, Hilbert transformers 


8.2.3 FIR Filter Design 

The design of FIR filters involves the selection of a finite sequence that best represents the impulse response 
of an ideal filter. FIR filters are always stable. Even more important, FIR filters are capable of perfectly 
linear phase (a pure time delay), meaning total freedom from phase distortion. For given specifications, 
however, FIR filters typically require a much higher filter order or length than do HR filters. And sometimes 
we must go to great lengths to ensure linear phase! The three most commonly used methods for FIR filter 
design are window-based design using the impulse response of ideal filters, frequency sampling, and iterative 
design based on optimal constraints. 
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8.3 Window-Based Design 

The window method starts by selecting the impulse response hjy [n] as a symmetrically truncated version of 
the impulse response h[n\ of an ideal filter with frequency response H(F). The impulse response of an ideal 
lowpass filter with a cutoff frequency Fc is h[n] = 2Fc sinc(2nFc). Its symmetric truncation yields 

h N [n] = 2F c smc(2nF c ), \n\ < 0.5(iV - 1) (8.5) 

Note that for an even length N, the index n is not an integer. Even though the designed filter is an 
approximation to the ideal filter, it is the best approximation (in the mean square sense) compared to any 
other filter of the same length. The problem is that it shows certain undesirable characteristics. Truncation 
of the ideal impulse response h[n\ is equivalent to multiplication of h[n] by a rectangular window u>[n] of 
length N. The spectrum of the windowed impulse response hw[n\ = is the (periodic) convolution 

of H(F) and W(F). Since W(F) has the form of a Dirichlet kernel, this spectrum shows overshoot and 
ripples (the Gibbs effect). It is the abrupt truncation of the rectangular window that leads to overshoot and 
ripples in the magnitude spectrum. To reduce or eliminate the Gibbs effect, we use tapered windows. 


| REVIEW PANEL 8.3 | 

The Spectrum of the Truncated Ideal Impulse Response Shows the Gibbs Effect 

hzi[ri\ = 2Fc sinc(2?iFc), \n\ < 0.5(N — 1) 

The Gibbs effect (spectral overshoot and oscillation) is due to abrupt truncation of h[n]. 
Tapered windows reduce (or eliminate) the spectral overshoot and oscillation. 


8.3.1 Characteristics of Window Functions 

The amplitude response of symmetric, finite-duration windows invariably shows a mainlobe and decaying 
sidelobes that may be entirely positive or that may alternate in sign. The spectral measures for a typical 
window are illustrated in Figure 8.7. 



Figure 8.7 Spectrum of a typical window 

Amplitude-based measures for a window include the peak sidelobe level (PSL), usually in decibels, and 
the decay rate Dg in dB/dec. Frequency-based measures include the mainlobe width Wm, the 3-dB and 
6 -dB widths (IT 3 and Wq), and the width Ws to reach the peak sidelobe level. The windows commonly used 
in FIR filter design and their spectral features are listed in Table 8.2 and illustrated in Figure 8 . 8 . As the 
window length N increases, the width parameters decrease, but the peak sidelobe level remains more or less 
constant. Ideally, the spectrum of a window should approximate an impulse and be confined to as narrow a 
mainlobe as possible, with as little energy in the sidelobes as possible. 
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Table 8.2 Some Windows for FIR Filter Design 


Note: Iq{x) is the modified Bessel function of order zero. 

Window 

Expression w[n ], — 0.5(iV — 1) < n < 0.5 (N — 1) 

Boxcar 

1 

Cosine 

/ 717T \ 

C0S (v-J 

Riemann 

smci (iv-i)’ L>0 

Bartlett 

2\n\ 

N- 1 

von Hann (Hanning) 

0.5 + 0.5cos( 7V1 ) 

Hamming 

0.54 + 0.46 cos^J 

Blackman 

0.42 + 0.5 cos ( ^ H7T 1 ) + 0.08 cos ( ^ 1 ) 

Kaiser 

IoW\/l-4[n/(^-l)] 2 ) 

Io(n[3) 


Spectral Characteristics of Window Functions 

Window 

G P 

Gs/Gp 

^sl (dB) 

W M 

Ws 

w 6 

w 3 

D s 

Boxcar 

1 

0.2172 

13.3 

1 

0.81 

0.6 

0.44 

20 

Cosine 

0.6366 

0.0708 

23 

1.5 

1.35 

0.81 

0.59 

40 

Riemann 

0.5895 

0.0478 

26.4 

1.64 

1.5 

0.86 

0.62 

40 

Bartlett 

0.5 

0.0472 

26.5 

2 

1.62 

0.88 

0.63 

40 

von Hann (Hanning) 

0.5 

0.0267 

31.5 

2 

1.87 

1.0 

0.72 

60 

Hamming 

0.54 

0.0073 

42.7 

2 

1.91 

0.9 

0.65 

20 

Blackman 

0.42 

0.0012 

58.1 

3 

2.82 

1.14 

0.82 

60 

Kaiser (/? = 2.6) 

0.4314 

0.0010 

60 

2.98 

2.72 

1.11 

0.80 

20 


NOTATION: 

Gp : Peak gain of mainlobe Gs : Peak sidelobe gain Dg: High-frequency attenuation (dB/decade) 

Asl- Sidelobe attenuation (q^~) in dB Wq: 6-dB half-width Ws : Half-width of mainlobe to reach Ps 

W 3 3-dB half-width \Vm- Half-width of mainlobe 


Notes: 

1. All widths (Wm , Ws, Wq , Wq) must be normalized (divided) by the window length N. 

2. Values for the Kaiser window depend on the parameter (3. Empirically determined relations are 


|sinc(j/3)| 


Gs _ 0.22tt/3 
Gp sinh(7r/3) ’ 


W M = { 1 + /? 2 ) 1/2 , 


W s = (0.661 + /3 2 ) 1/2 
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Most windows have been developed with some optimality criterion in mind. Ultimately, the trade-off 
is a compromise between the conflicting requirements of a narrow mainlobe (or a small transition width), 
and small sidelobe levels. Some windows are based on combinations of simpler windows. For example, 
the von Hann (or Hanning) window is the sum of a rectangular and a cosine window, the Bartlett window 
is the convolution of two rectangular windows, and the cos ' 2 window is the product of a von Hann and 
a cosine window. Other windows are designed to emphasize certain desirable features. The von Hann 
window improves the high-frequency decay (at the expense of a larger peak sidelobe level). The Hamming 
window minimizes the sidelobe level (at the expense of a slower high-frequency decay). The Kaiser window 
has a variable parameter (3 that controls the peak sidelobe level. Still other windows are based on simple 
mathematical forms or easy application. For example, the cos a windows have easily recognizable transforms, 
and the von Hann window is easy to apply as a convolution in the frequency domain. An optimal time-limited 
window should maximize the energy in its spectrum over a given frequency band. In the continuous-time 
domain, this constraint leads to a window based on prolate spheroidal wave functions of the first order. The 
Kaiser window best approximates such an optimal window in the discrete domain. 


8.3.2 Some Other Windows 


The Dolph (also called Chebyshev) window corresponds to the inverse DTFT of a spectrum whose sidelobes 
remain constant (without decay) at a specified level and whose mainlobe width is the smallest for a given 
length. The time-domain expression for this window is cumbersome. This window can be computed from 


w[n] = IDFT Tjv_i 


a cos 


IV — 1 


= cosh 


cosh '(Iff 4 / 20 ) 


TV — 1 


(odd n only) 


( 8 . 6 ) 


Here, T n {x) is the Chebyshev polynomial of order n, and A is the sidelobe attenuation in decibels. 


Table 8.3 Characteristics of Harris Windows 


Notes: Asl is the normalized peak sidelobe attenuation in dB (decibels). 

Wg is the half-width of the main lobe to reach Pg. 

Dg is the high frequency decay rate in dB/octave (6 dB/oct = 20 dB/dec). 

Type 

bo 

bi 

b 2 

h 

A S l (dB) 

W s = K/N 

D S 

0 

0.375 

0.5 

0.125 

0.0 

46.74 

K = 2.89 

30 

1 

10/32 

15/32 

6/32 

1/32 

60.95 

K = 3.90 

42 

2 

0.40897 

0.5 

0.09103 

0.0 

64.19 

K = 2.94 

18 

3 

0.42323 

0.49755 

0.07922 

0.0 

70.82 

K = 2.95 

6 

4 

0.4243801 

0.4973406 

0.0782793 

0.0 

71.48 

K = 2.95 

6 

5 

0.338946 

0.481973 

0.161054 

0.018027 

82.6 

K = 3.95 

30 

6 

0.355768 

0.487396 

0.144232 

0.012604 

92.32 

K = 3.96 

18 

7 

0.3635819 

0.4891775 

0.1365995 

0.0106411 

98.17 

K = 3.96 

6 


Harris windows offer a variety of peak sidelobe levels and high-frequency decay rates. Their characteristics 
are listed in Table 8.3. Harris windows have the general form 

w[n] = b 0 — bi cos( to) + 62 cos(2m) — 63 cos(3m), where m = — —|n| < ——— (8.7) 
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8.3.3 What Windowing Means 

Symmetric windowing of the impulse response of an ideal filter is accomplished by windows that are them¬ 
selves symmetric, as illustrated in Figure 8.9. 



Figure 8.9 The mechanics of windowing 

An 7V-point FIR window uses TV — 1 intervals to generate N samples (including both end samples). Once 
selected, the window sequence must be symmetrically positioned with respect to the symmetric impulse 
response sequence. Windowing is then simply a pointwise multiplication of the two sequences. 

The symmetrically windowed impulse response of an ideal lowpass filter may be written as 

h w [n] = 2F c smc(2nF c )w[n], -0.5(A - 1) < n < 0.5(7V - 1) ( 8 . 8 ) 

For even N, the index n is not an integer, even though it is incremented every unit, and we require a non¬ 
integer delay to produce a causal sequence. If the end samples of w [n] equal zero, so will those of h\y [«], 
and the true filter length will be less by 2 . 


EXAMPLE 8.1 (Truncation and Windowing) 

Consider a lowpass filter with a cutoff frequency of 5 kHz and a sampling frequency of 20 kHz. 

Then, Fc = 0.25 and h[n] = 2Fc sinc(2nFc) = 0.5 sinc(0.5n). 

(a) With N = 9 and a Bartlett window u> = 1 — , —4 < n < 4, we find 

h[n} = {0, —0.1061, 0, 0.3183, o\ 0.3183, 0, -0.1061, 0} 
w[n] = {0, 0.25, 0.5, 0.75, 1, 0.75, 0.5, 0.25, 0} 

Pointwise multiplication of Jin and wn gives 

h w [n] = { 0, -0.0265, 0, 0.2387, o\ 0.2387, 0, -0.0265, 0} 

If we include the end samples, the causal filter requires a delay of four samples to give 

H c (z) = 0 - 0.0265W 1 + 0.2387z -3 + 0.5z~ 4 + 0.2387W 5 - 0.0265.W 7 

Since S = 20 kHz, we have t s = 1/S = 0.05 ms, and a four-sample delay corresponds to an actual 
delay of 4(0.05) = 0.2 ms. If we ignore the end samples, the causal filter requires a delay of only three 
(not four) samples to give 

H c (z) = -0.0265 + 0.2387a; -2 + 0.5^ -3 + 0.23872 -4 - 0.02652 -6 
This corresponds to a delay of 0.15 ms. 


©Ashok Ambardar, September 1, 2003 



322 


Chapter 8 Design of FIR Filters 


(b) With N = 6, we have Fq = 0.25 and ftjv[n] = 2Fq sinc(2ni 7 'c) = 0.5sinc(0.5n), —2.5 < n < 2.5. 

For a von Hann (Hanning) window, ui[n] = 0.5 + 0.5cos(^(5j;) = 0.5 + 0.5 cos(0.4n7r), —2.5 <n< 2.5. 

We then compute values of h[n], w[n], and hw[n] = ft[n]iy[n] as 


-0.09 

0.1501 

0.4502 

0.4502 

0.1501 

-0.09 

0.0 

0.3455 

0.9045 

0.9045 

0.3455 

0.0 

0.0 

0.0518 

0.4072 

0.4072 

0.0518 

0.0 


Since the first sample of h\y [n] is zero, the minimum delay required for a causal filter is only 1.5 (and 
not 2.5) samples, and the transfer function of the causal sequence is 

H c (z) = 0.0518 + 0.4072z _1 + 0.40722" 2 + 0.05182" 3 


8.3.4 Some Design Issues 

The gain of a typical lowpass filter using window-based design is illustrated in Figure 8.10. The gain 
specifications of an FIR filter are often based on the passband ripple 5 p (the maximum deviation from unit 
gain) and the stopband ripple S s (the maximum deviation from zero gain). Since the decibel gain is usually 
normalized with respect to the peak gain, the passband and stopband attenuation A p and A s (in decibels) 
are related to these ripple parameters by 

Hp(dB) - -20log^ | H s (dB) = -201og ^ + ^ ^ ss -20log S s , < 1 (8.9) 

To convert attenuation specifications (in decibels) to values for the ripple parameters, we use 

1 n A v/ 20 _ 1 

S P = i oAp/20 + x < 5 S = (1 + ^) 10-^/ 20 « 10 -^/ 20 , « 1 ( 8 . 10 ) 




Figure 8.10 The features of a typical filter 


Window-based design calls for normalization of the design frequencies by the sampling frequency, devel¬ 
oping the lowpass filter by windowing the impulse response of an ideal filter, and conversion to the required 
filter type, using spectral transformations. The method may appear deceptively simple (and it is), but some 
issues can only be addressed qualitatively. For example, the choice of cutoff frequency is affected by the 
window length N. The smallest length N that meets specifications depends on the choice of window, and 
the choice of the window, in turn, depends on the (stopband) attenuation specifications. 
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8.3.5 Characteristics of the Windowed Spectrum 

When we multiply the ideal impulse response h[n] = 2Fc smc(2nFc) by a window w[n\ of length N in the 
time domain, the spectrum of the windowed impulse response hw [n] = h [n] w [n] is the (periodic) convolution 
of H(F) and W(F), as illustrated in Figure 8.11. 



Transition width F T s window mainlobe width 
Peak stopband ripple = peak sidelobe level of wine 



Figure 8.11 The spectrum of a windowed ideal filter 

The ideal spectrum has a jump discontinuity at F = Fc . The windowed spectrum shows overshoot and 
ripples, and a finite transition width but no abrupt jump. Its magnitude at F = Fc equals 0.5 (corresponding 
to an attenuation of 6 dB). 

Table 8.4 lists the characteristics of the windowed spectrum for various windows. It excludes windows 
(such as the Bartlett window) whose amplitude spectrum is entirely positive (because they result in a 
complete elimination of overshoot and the Gibbs effect). Since both the window function and the impulse 
response are symmetric sequences, the spectrum of the windowed filter is also endowed with symmetry. Here 
are some general observations about the windowed spectrum: 

1. Even though the peak passband ripple equals the peak stopband ripple (6 P = 8 a ), the passband (or 
stopband) ripples are not of equal magnitude. 

2. The peak stopband level of the windowed spectrum is typically slightly less than the peak sidelobe level 
of the window itself. In other words, the filter stopband attenuation (listed as Hws hr Table 8.4) is 
typically greater (by a few decibels) than the peak sidelobe attenuation of the window (listed as Hsl in 
Tables 8.2 and 8.3). The peak sidelobe level, the peak passband ripple, and the passband attenuation 
(listed as A\yp in Table 8.4) remain more or less constant with N. 

3. The peak-to-peak width across the transition band is roughly equal to the mainlobe width of the 
window (listed as Wm in Tables 8.2 and 8.3). The actual transition width (listed as Fw in Table 8.4) 
of the windowed spectrum (when the response first reaches 1 — 8 P and S a ) is less than this width. The 
transition width F W s is inversely related to the window length N (with F ws « C/N , where C is more 
or less a constant for each window). 

The numbers vary in the literature, and the values in Table 8.4 were found here by using an ideal impulse 
response h[n] = 0.5sinc(0.5n), with Fc = 0.25, windowed by a 51-point window. The magnitude specifi¬ 
cations are normalized with respect to the peak magnitude. The passband and stopband attenuation are 
computed from the passband and stopband ripple (with 8 P = 8 a ), using the relations already given. 
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Table 8.4 Characteristics of the Windowed Spectrum 



Peak 

Passband 

Peak Sidelobe 

Transition 

Window 

Ripple 

Attenuation 

Attenuation 

Width 


6 P = 5 S 

A W p (dB) 

A W s (dB) 

Fws « C/N 

Boxcar 

0.0897 

1.5618 

21.7 

C = 0.92 

Cosine 

0.0207 

0.36 

33.8 

C = 2.1 

Riemann 

0.0120 

0.2087 

38.5 

C= 2.5 

von Hann (Hanning) 

0.0063 

0.1103 

44 

C = 3.21 

Hamming 

0.0022 

0.0384 

53 

C = 3.47 

Blackman 

(1.71)10 -4 

(2.97)10 -3 

75.3 

C = 5.71 

Dolph (R = 40 dB) 

0.0036 

0.0620 

49 

C = 3.16 

Dolph (R = 50 dB) 

(9.54)10 -4 

0.0166 

60.4 

C = 3.88 

Dolph (R = 60 dB) 

(2.50)10 -4 

0.0043 

72 

C = 4.6 

Harris (0) 

(8.55)10 -4 

0.0148 

61.4 

C = 5.36 

Harris (1) 

(1.41)KT 4 

(2.44) 10" 3 

77 

C = 7.45 

Harris (2) 

(1.18)10 -4 

(2.06)10 -3 

78.5 

C= 5.6 

Harris (3) 

(8.97)10 -5 

(1.56)10 -3 

81 

C= 5.6 

Harris (4) 

(9.24)10 -5 

(1.61)10 -3 

81 

C= 5.6 

Harris (5) 

(9.96)10 -6 

(1.73)10 -4 

100 

C = 7.75 

Harris (6) 

(1.94)10 -6 

(3.38)10 -5 

114 

C = 7.96 

Harris (7) 

(5.26)10 -6 

(9.15)10 -5 

106 

C = 7.85 


8.3.6 Selection of Window and Design Parameters 

The choice of a window is based primarily on the design stopband specification A s . The peak sidelobe 
attenuation A\yg of the windowed spectrum (listed in Table 8.4) should match (or exceed) the specified 
stopband attenuation A s . Similarly, the peak passband attenuation A-wp of the windowed spectrum should 
not exceed the specified passband attenuation A p , a condition that is often ignored because it is usually 
satisfied for most practical specifications. 

The windowed spectrum is the convolution of the spectra of the impulse response and the window function, 
and this spectrum changes as we change the filter length. An optimal (in the mean square sense) impulse 
response and an optimal (in any sense) window may not together yield a windowed response with optimal 
features. Window selection is at best an art, and at worst a matter of trial and error. Just so you know, the 
three most commonly used windows are the von Hann (Hanning), Hamming, and Kaiser windows. 

Choosing the Filter Length 

The transition width of the windowed spectrum decreases with the length N. There is no accurate way to 
establish the minimum filter length N that meets design specifications. However, empirical estimates are 
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based on matching the given transition width specification Ft to the transition width Fw s = C/N of the 
windowed spectrum (as listed in Table 8.4) 

C C 

F t =F s ~F v = F ws « — N = - (8.11) 

1 8 p Wb N F s -F p y 1 

Here, F p and F s are the digital passband and stopband frequencies. The window length depends on the 
choice of window (which dictates the choice of C ). The closer the match between the stopband attenuation 
A s and the stopband attenuation Aws of the windowed spectrum, the smaller is the window length N. In 
any case, for a given window, this relation typically overestimates the smallest filter length, and we can often 
decrease this length and still meet design specifications. 


The Kaiser Window 

Empirical relations have been developed to estimate the filter length N of FIR filters based on the Kaiser 
window. We first compute the peak passband ripple 5 P , and the peak stopband ripple 5 S , and choose the 
smallest of these as the ripple parameter 5: 

-mA p /20 _ i 

S P = 10 A P /20 + ! S s = 10~ A ^ 20 6 = mm(S p ,S s ) (8.12) 

The ripple parameter 6 is used to recompute the actual stopband attenuation A s0 in decibels: 


A s0 = —20 log S dB 

Finally, the length N is well approximated by 

A s0 - 7.95 

I 14 

N > 


+ 1, A s0 A 21 dB 


UM(F S - F p ) 

0.9222 

+ 1, A s0 < 21 dB 


(8.13) 


(8.14) 


F - F 

1 n j p 

The Kaiser window parameter (3 is estimated from the actual stopband attenuation H s o, as follows: 

0.0351(H sO - 8.7), A s0 > 50 dB 

(3 = { 0.186(H s o- 21) o - 4 + 0.0251 (H sO -21), 21 dB < H s0 < 50 dB 

0, H s0 < 21 dB 


(8.15) 


Choosing the Cutoff Frequency 

A common choice for the cutoff frequency (used in the expression for h[n]) is Fc = 0.5 (F p + F s ). The actual 
frequency that meets specifications for the smallest length is often less than this value. The cutoff frequency 
is affected by the filter length N. A design that ensures the minimum length N is based on starting with the 
above value of Fc, and then changing (typically reducing) the length and/or tweaking (typically decreasing) 
Fc until we just meet specifications (typically at the passband edge). 

8.3.7 Spectral Transformations 

A useful approach to the design of FIR filters other than lowpass starts with a lowpass prototype developed 
from given specifications. This is followed by appropriate spectral transformations to convert the lowpass 
prototype to the required filter type. Finally, the impulse response may be windowed by appropriate windows. 
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The causal impulse response has the form 

hup[k] = <5[fc — 7] — 0.6sinc[0.6(/c — 7)], 0 < k < 14 

The second form of the LP2HP transformation uses the shifting property of the DTFT. Shifting the spectrum 
by F = 0.5 results in multiplication of the corresponding time signal by (—1)" (a change in the sign of every 
other sample value). Shifting the spectrum of a lowpass filter by F = 0.5 results in the highpass form 

Hkp(F) = H hP (F - 0.5) 

Note that this transformation is valid for any lowpass filter (FIR or HR) with any length N (even or odd). 
If the lowpass filter has a cutoff frequency of Fc, a consequence of the frequency shift is that the cutoff 
frequency of the resulting highpass filter is Fh = 0.5 — Fc regardless of the filter type. To design a highpass 
filter with a cutoff frequency of Fh, we must start with a lowpass prototype whose cutoff frequency is 
Fc = 0.5 — Fh- For an ideal causal filter, we start with the lowpass prototype 

h LP [k] = 2F c smc{2[k-0.5(N-1)]F C }, 0 < k < N - 1 where F c = 0.5 - F H 

The causal impulse response of the highpass filter is then 

h H p[k] = {-l) k h LP [k}, 0<k<N-l (8.17) 

As an example, if we wish to design a highpass filter of length N = 12 with a cutoff frequency of Fh = 0.3, 
we start with a causal lowpass prototype whose cutoff frequency is Fc = 0.2 and whose impulse response is 

h L p [fc] = 0.4sinc[0.4(fc — 5.5)], 0 < k < 11 

The causal impulse response of the highpass filter is then given by 

/iup[fc] = (—l) fe /iLp[fc], 0 < k < 11 

The LP2BP and LP2BS transformations are based on arithmetic symmetry about the center frequency 
Fq. If the band edges are [Fi, F^, F 3 , F 4 ] in increasing order, arithmetic symmetry means that F\ + F 4 = 
F 2 + F 4 = 2Fq and implies equal transition widths. If the transition widths are not equal, we must relocate 
a band edge to make both transition widths equal to the smaller transition width, as shown in Figure 8.13. 


H(F) Bandpass 



No arithmetic symmetry 


Relocate F d 


> 


H(F) Bandpass 



Arithmetic symmetry 


Figure 8.13 How to ensure arithmetic symmetry of the band edges 


The LP2BP and LP2BS transformations are illustrated in Figure 8.14. In each transformation, the center 
frequency Fq is given by 

F 0 = 0.5 (F 2 + F 3 ) = 0.5 (F\ + F 4 ) (8.18) 

The lowpass-to-bandpass (LP2BP) transformation results by shifting the spectrum of a lowpass filter by 
±F 0 to give 

Hbp(F) = H hP (F + F 0 ) + H hP (F - F 0 ) 
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From Figure 8.14, the cutoff frequency Fc of the lowpass prototype is 

Fc = 0.5(F3 + F 4 ) — Fq (8.19) 

From the modulation property of the DTFT, shifting the spectrum Hpp(F) of the lowpass filter by ±Fo 
results in multiplication of its impulse response /ilp[ n] by 2cos(27rnFo) and we obtain the impulse response 
of the bandpass filter as 

TV - 1 TV - 1 

hBp[n] = 2 cos( 2 n 7 rFo)/iLp[n] = 4Fcsinc(2nFc) cos(27rnFo),--— <n< ——— (8.20) 

Upon re-indexing, its causal version assumes the form hpp[k] , 0 < k < TV — 1 where k = n + 0.5(TV — 1). 

A bandstop filter requires a type 4 sequence (with even symmetry and odd length TV). The lowpass-to- 
bandstop (LP2BS) transformation of Figure 8.14 is described by Hbs(F) = 1 — Hbp(F) and leads to the 
noncausal impulse response 

TV- 1 TV- 1 

h B s[n] = <5[n] — hBp[n] = <5[n] — 4Fcsinc(2nFc) cos(27rnF 0 ),- — < n < ——— (8-21) 

Upon re-indexing, its causal version has the form Tibs [A], 0 < k < TV — 1 where k = n + 0.5(TV — 1). 

A second form of the LP2BS transformation results by describing the bandstop filter as the sum of a 
lowpass filter with a cutoff frequency of Fp = 0.5(F! + F 2 ) and a highpass filter with a cutoff frequency of 
Fh = 0.5(F 3 + F 4 ). The noncausal impulse response of the bandstop filter is thus given by 

TV — 1 TV - 1 

TibsM = 2F L sinc(2nFi) + 2(—l) n (0.5 — F H ) sinc[2?r(0.5 — F H )], - — < n < ——— (8.22) 

Upon re-indexing, its causal version has the form Tins [k] , 0 < k < TV — 1 where k = n + 0.5(TV — 1). 


H(F) Bandpass 



Lowpass prototype 



F 0 = 0.5 (F 2 +F 3 ) F c = 0.5 (F 3 + F 4 ) - F 0 
li BP |/i| = 4F ( , sincC/j/y. )cos(27t/t F f) ) w [n| 


H(F) Bandstop 



Lowpass prototype 



F 0 = 0.5(F 2 + F 3 ) F c = 0.5(F 3 + F 4 ) - F 0 
li BS |/i| = §[«]- 4F C sinc(2nF c )cos(2nnF Q ) w \n\ 


Figure 8.14 The lowpass-to-bandpass and lowpass-to-bandstop transformations 


| REVIEW PANEL 8.4 | 

Impulse Response of Windowed Filters Over |n| < 0.5(TV — 1) 
hp[n] = 2Fc sinc(2nFc) /*hpN = ~ hp[n] Fc = cutoff frequency of lowpass prototype 

hBp[n] = 2h P [n]cos(2TTnF 0 ) TibsW = — ^bpN Fq = center frequency (for BPF and BSF) 
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REVIEW PANEL 8.5 
Recipe for Window-Based FIR Filter Design 

Normalize the analog design frequencies by the sampling frequency S. 

Obtain the band edges F p and F s of the lowpass prototype. 

Choose the lowpass prototype cutoff as Fc = 0.5(F p + F s ). 

Choose a window (from Table 8.4) that satisfies Aws > A s and Awp < A p . 

Compute the window length N from Ft = F s — F p = Ews = 77 (with C as in Table 8.4). 
Compute the prototype impulse response h[n] = 2Fc sine[2nFc], |n| < 0.5 (N — 1). 

Window h[n] and apply spectral transformations (if needed) to convert to required filter type. 
Minimum-length design: Adjust N and/or Fc until the design specifications are just met. 


EXAMPLE 8.2 (FIR Filter Design Using Windows) 

(a) Design an FIR filter to meet the following specifications: 

f p = 2 kHz, f s = 4 kHz, A p = 2 dB, A s = 40 dB, and sampling frequency S = 20 kHz. 

This describes a lowpass filter. The digital frequencies are F p = f p /S = 0.1 and F s = f s /S = 0.2. 

With A s = 40 dB, possible choices for a window are (from Table 8.4) von Hann (with Aws = 44 dB) 
and Blackman (with A\ys = 75.3 dB). Using Fws ~ (Fa ~ F p ) = C/N, the approximate filter lengths 
for these windows (using the values of C from Table 8.4) are: 

von HanmiV ss 2A4 « 33 Blackman: A « ~ 58 

We choose the cutoff frequency as Fc = 0.5(E p + F s ) = 0.15. The impulse then response equals 

hN[n] = 2Fc sinc(2nFc) = 0.3 sinc(0.3n) 

Windowing gives the impulse response of the required lowpass filter 


h LP [n] = w[n\h]y[n\ = 0.3u>[n]sinc(0.3n) 

As Figure E8.2A(a) shows, the design specifications are indeed met by each filter (but the lengths are 
actually overestimated). The Blackman window requires a larger length because of the larger difference 
between A s and Aws- It also has the larger transition width. 



0 0.1 0.15 0.2 0.3 0.4 0.5 


0 0.1 0.15 0.2 0.3 0.4 0.5 


Digital frequency F 


Digital frequency F 


Figure E8.2A Lowpass FIR filters for Example 8.2(a and b) 
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(b) (Minimum-Length Design) By trial and error, the cutoff frequency and the smallest length that 
just meet specifications turn out to be Fc = 0.1313, N = 23, for the von Hann window, and Fc = 
0.1278, N = 29, for the Blackman window. Figure E8.2A(b) shows the response of these minimum- 
length filters. The passband and stopband attenuation are [1.9, 40.5] dB for the von Hann window, 
and [1.98, 40.1] dB for the Blackman window. Even though the filter lengths are much smaller, each 
filter does meet the design specifications. 


(c) Design an FIR filter to meet the following specifications: 

f p = 4 kHz, f s = 2 kHz, A p = 2 dB, A s = 40 dB, and sampling frequency S = 20 kHz. 

The specifications describe a highpass filter. The digital frequencies are F p = f p /S = 0.2 and F s = 
fs/S = 0.1. The transition width is Ft = 0.2 — 0.1 = 0.1. 

With A s = 40 dB, possible choices for a window (see Table 8.4) are Hamming and Blackman. Using 
Ft « Fws = C/N, the approximate filter lengths for these windows are 

HammingW ss « 35 BlackmanW « ss 58 

We can now design the highpass filter in one of two ways: 


1. Choose the cutoff frequency of the lowpass filter as Fq = 0.5 (F p + F s ) = 0.15. The impulse 
response hiy[n\ then equals 

/ijvM = 2Fcsinc(2nFc) = 0.3 sinc(0.3n) 

The windowed response is thus hw[n] = 0.3w[n]sinc(0.3n). 

The impulse of the required highpass filter is then 

/&hp[ji] = 5[n] — hw[n] = <5[n] — 0.3w[?r]sinc(0.3n) 

2. Choose the cutoff frequency of the lowpass filter as Fc = 0.5 — 0.5(F p + F s ) = 0.35. 

Then, the impulse response equals hjsr[n] = 2Fq sinc(2?iFc) = 0.7 sinc(0.7n). 

The windowed response is thus h\y[n] = 0.7w[n]sinc(0.7n). 

The impulse of the required highpass filter is then 

/ihp[«] = (— l) n hw[n] = 0.7(—l)"u;[n]sinc(0.7n) 

The two methods yield identical results. As Figure E8.2B(a) shows, the design specifications are indeed 
met by each window, but the lengths are actually overestimated. 
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(a) Highpass filter using Hamming and Blackman windows < b > Hamming: LPP F= 0.3293 Minimum N= 22 


LPP F c =0.35 Hamming N= 35 Blackman 1V=58 
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Figure E8.2B Highpass FIR filters for Example 8.2(c and d) 


(d) (Minimum-Length Design) By trial and error, the cutoff frequency, and the smallest length that 
just meet specifications, turn out to be Fq = 0.3293, N = 22, for the Hamming window, and Fq = 
0.3277, N = 29, for the Blackman window. Figure E8.2B(b) shows the response of the minimum-length 
filters. The passband and stopband attenuation are [1.94, 40.01] dB for the Hamming window, and 
[1.99, 40.18] dB for the Blackman window. Each filter meets the design specifications, even though the 
filter lengths are much smaller than the values computed from the design relations. 


(e) Design an FIR filter to meet the following specifications: 

A p = 3 dB, A s = 45 dB, passband: [4, 8] kHz, stopband: [2, 12] kHz, and S = 25 kHz. 

The specifications describe a bandpass filter. If we assume a fixed passband, the center frequency lies 
at the center of the passband and is given by /o = 0.5(4 + 8) = 6 kHz. 

The specifications do not show arithmetic symmetry. The smaller transition width is 2 kHz. For 
arithmetic symmetry, we therefore choose the band edges as [2, 4, 8, 10] kHz. 

The digital frequencies are: passband [0.16, 0.32], stopband [0.08, 0.4], and F 0 = 0.24. 

The lowpass band edges become F p = 0.5(F p2 — F p i) = 0.08 and F s = 0.5(F s2 — F s i) = 0.16. 

With A s = 45 dB, one of the windows we can use (from Table 8.4) is the Hamming window. 

For this window, we estimate F W s ~ (F s — F p ) = C/N to obtain N = 3.47/0.08 = 44. 

We choose the cutoff frequency as Fc = 0.5 (F p + F s ) = 0.12. 

The lowpass impulse response is h^[n] = 2Fq sinc(2?iFc) = 0.24 sinc(0.24?i), —21.5 <n< 21.5. 
Windowing this gives hw[n\ = /ijv[n]«;[n], anc ^ the LP2BP transformation gives 
/ibp[«] = 2 cos(2nnF 0 )hw[n] = 2cos(0.487m)/qy M 
Its frequency response is shown in Figure E8.2C(a) and confirms that the specifications are met. 
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Figure E8.2C Bandpass FIR filters for Example 8.2(e) 


The cutoff frequency and smallest filter length that meets specifications turn out to be smaller. By 
decreasing N and Fq, we find that the specifications are just met with TV = 27 and Fq = 0.0956. For 
these values, the lowpass filter is ftjv[n] = 2Fq sinc(2nFc) = 0.1912 sinc(0.1912n), —13 < n < 13. 

Windowing and bandpass transformation yields the filter whose spectrum is shown in Figure E8.2C(b). 
The attenuation is 3.01 dB at 4 kHz and 8 kHz, 45.01 dB at 2 kHz, and 73.47 dB at 12 kHz. 


8.4 Half-Band FIR Filters 

A half-band FIR filter has an odd-length impulse response h[n\ whose alternate samples are zero. The main 
advantage of half-band filters is that their realization requires only about half the number of multipliers. 
The impulse response of an ideal lowpass filter is h[n] = 2 Fq sinc(2 nFc). If we choose Fq = 0.25, we obtain 

h[n) = 2 F c sinc(2 nF c ) = 0.5 sinc(0.5n), \n\ < 0.5(iV - 1) (8.23) 

Thus, h[n) = 0 for even n, and the filter length N is always odd. Being a type 1 sequence, its transfer 
function H(F) displays even symmetry about F = 0. It is also antisymmetric about F = 0.25, with 

H(F) = 1- i7(0.5 - F) (8.24) 

A highpass half-band filter also requires Fc = 0.25. If we choose Fc = 0.5(7), + F s ), the sampling frequency 
S must equal 2 (f p + f s ) to ensure Fc = 0.25, and cannot be selected arbitrarily. Examples of lowpass 
and highpass half-band filters are shown in Figure 8.15. Note that the peak passband ripple and the peak 
stopband ripple are of equal magnitude, with 5 p = 8 S = 5 (as they are for any symmetric window). 

Since the impulse response of bandstop and bandpass filters contains the term 2 cos (2nnFo) /i LP [n], a 
choice of F () = 0.25 (for the center frequency) ensures that the odd-indexed terms vanish. Once again, the 
sampling frequency S cannot be arbitrarily chosen, and must equal 4/o to ensure To = 0.25. Even though 
the choice of sampling rate may cause aliasing, the aliasing will be restricted primarily to the transition band 
between f p and f s , where its effects are not critical. 

Except for the restrictions in the choice of sampling rate S (which dictates the choice of Fc for lowpass 
and highpass filters, or To for bandpass and bandstop filters) and an odd length sequence, the design of 
half-band filters follows the same steps as window-based design. 
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(a) Amplitude of a half-band lowpass filter 
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(b) Amplitude of a half-band highpass filter 
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Figure 8.15 Characteristics of lowpass and highpass half-band filters 


1 REVIEW PANEL 8.6 [ 

Recipe for Design of Half-Band FIR Filters 

Fix S = 2 (f p + f s ) (for LPF and HPF) or S = 4/ 0 (for BPF and BSF). 

Find F p and F s for the lowpass prototype and pick Fc = 0.5 (F p + F s ). 

Choose an odd filter length N. 

Compute the prototype impulse response h[n\ = 2Fc sinc[2nFc], |n| < 0.5(1V — 1). 

Window the impulse response and apply spectral transformations to convert to required filter. 
If the specifications are exceeded, decrease N (in steps of 2) until specifications are just met. 


EXAMPLE 8.3 (Half-Band FIR Filter Design) 

(a) Design a lowpass half-band filter to meet the following specifications: 

Passband edge: 8 kHz, stopband edge: 16 kHz, A p = 1 dB, and A s = 50 dB. 

We choose S = 2(f p + f s ) = 48 kHz. The digital band edges are F p = g, F s = |, and Fc = 0.25. 
The impulse response of the filter is h[n] = 2Fc siiic(2nFc) = 0.5sinc(0.5n). 

1. If we use the Kaiser window, we compute the filter length N and the Kaiser parameter (3 as 
follows: 

i qA p /20 _ i 

Sp= — a—T on -= 0.0575 S s = 10“^ s/2 ° = 0.00316 <5 = 0.00316 A s0 = -20 log 5 = 50 

1QA p /2U _|_ 

N = 14 ^ s 6 ° ( ~ ) + 1 = 18.57 w 19 p = 0.0351(A s0 - 8.7) = 1.4431 

The impulse response is therefore h^[n] = 0.5 sinc(0.5n), —9 <n< 9. 

Windowing h v [n\ gives the required impulse response h\y [n]. 

Figure E8.3A(a) shows that this filter does meet specifications with an attenuation of 0.045 dB at 
8 kHz and 52.06 dB at 16 kHz. 
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(a) Kaiser half-band LPF: p= 1.44, N= 19, F c = 0.25 (b) Hamming half-band LPF: N= 21 F c = 0.25 



0 0.166 0.25 0.333 0.5 0 0.166 0.25 0.333 0.5 
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Figure E8.3A Lowpass half-band filters for Example 8.3(a) 


2. If we choose a Hamming window, we use Table 8.4 to approximate the odd filter length as 


Fws = F s - F p = — 


F — F 

M ft 


This value of N meets specifications and also turns out to be the smallest length that does. Its 
response is plotted in Figure E8.3A(b). This filter shows an attenuation of 0.033 dB at 8 kHz and 
an attenuation of 53.9 dB at 16 kHz. 


(b) Design a bandstop half-band filter to meet the following specifications: 

stopband edges: [2, 3] kHz, passband edges: [1, 4] kHz, A p = 1 dB, and A s = 50 dB. 

Since both the passband and the stopband are symmetric, we have /o = 0.5(2 + 3) = 2.5 kHz. 

We then choose the sampling frequency as S = 4/o = 10 kHz. The digital frequencies are 

stopband edges = [0.2, 0.3], passband edges = [0.1, 0.4], F 0 = 0.25. 

The specifications for the lowpass prototype are 

F p = 0.5(F S 2 — F s i) = 0.05, F s = 0.5(F p2 — F p i) = 0.15, F c = 0.5(F P + F s ) = 0.1 
The impulse response of the prototype is h[n] = 2Fc sinc(2nFc) = 0.2 sinc(0.2n). 

1. If we use the Kaiser window, we must compute the filter length N and the Kaiser parameter (3 
as follows: 

i qAp/20 _ i 

S p = . ... -= 0.0575 S s = 10 _A ' ,/2 ° = 0.00316 5 = 0.00316 = -20 log 5 = 50 

IQA P /2U _|_ ]_ 

N = 14 ^ s 6 ° ( ~ y + 1 = 30.28 w 31 P = 0.0351(H s0 - 8.7) = 1.4431 

The prototype impulse response is /ijv[n] = 0.2sinc(0.2n), —15 < n < 15. Windowing /ijv[n] 

gives hw[n]- We transform h\,y[n] to the bandstop form /ins[ n ]i using Fq = 0.25, to give 

/ibsM = 5[n] — 2cos(27rnFo)/ivv[n] = 5[n] — 2cos(0.57r?r)/iu/[?r] 

Figure E8.3B(a) shows that this filter does meet specifications, with an attenuation of 0.046dB 
at 2 kHz and 3 kHz, and 53.02 dB at 1 kHz and 4 kHz. 
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Figure E8.3B Bandstop half-band filters for Example 8.3(b) 

For a Hamming window, we use Table 8.4 to approximate the odd filter length as 


Fws = F s — F p = 


C_ 

N 


N = 


C 

F s - F p 


3.47 

"oT 


35 


This is also the smallest filter length that meets specifications. The magnitude response is shown 
in Figure E8.3B(b). We see an attenuation of 0.033 dB at [2, 3] kHz and 69.22 dB at [1, 4] kHz. 


8.5 FIR Filter Design by Frequency Sampling 

In window-based design, we start with the impulse response h[n] of an ideal filter, and use truncation and 
windowing to obtain an acceptable frequency response H(F). The design of FIR filters by frequency sampling 
starts with the required form for H(F ), and uses interpolation and the DFT to obtain h [n] . In this sense, it 
is more versatile, since arbitrary frequency response forms can be handled with ease. 

Recall that a continuous (but band-limited) signal h(t) can be perfectly reconstructed from its samples 
(taken above the Nyquist rate), using a sine interpolating function (that equals zero at the sampling instants). 
If h(t) is not band-limited, we get a perfect match only at the sampling instants. 

By analogy, the continuous (but periodic) spectrum H(F) can also be recovered from its frequency 
samples, using a periodic extension of the sine interpolating function (that equals zero at the sampling 
points). The reconstructed spectrum Hn(F) will show an exact match to a desired H(F) at the sampling 
instants, even though Hn(F) could vary wildly at other frequencies. This is the basis for FIR filter design 
by frequency sampling. Given the desired form for F[(F), we sample it at N frequencies, and find the IDFT 
of the Wpoint sequence H[k\, k = 0, 1,..., IV — 1. The following design guidelines stem both from design 
aspects as well as computational aspects of the IDFT itself. 

1. The N samples of H(F ) must correspond to the digital frequency range 0 < F < 1, with 

H[k]=H(F)\ p=k/N , k = 0, 1, 2,..., iV — 1 (8.25) 

The reason is that most DFT and IDFT algorithms require samples in the range 0 < k < N — 1. 

2. Since h[n ] must be real, its DFT H[k] must possess conjugate symmetry about k = 0.5 N (this is a 
DFT requirement). Note that conjugate symmetry will always leave H [0] unpaired. It can be set to 
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any real value, in keeping with the required filter type (this is a design requirement). For example, we 
must choose H[ 0] =0 for bandpass or highpass filters. 

3. For even length N, the computed end-samples of h[n] may not turn out to be symmetric. To ensure 
symmetry, we must force fi[0] to equal h[N] (setting both to 0.5/i[0], for example). 

4. For h[n] to be causal, we must delay it (this is a design requirement). This translates to a linear 
phase shift to produce the sequence |iZ[fc]|e- 7 '^. In keeping with conjugate symmetry about the index 
k — 0.5 N, the phase for the first N/2 samples of H[k] will be given by 

4>[ k \= ~ 7rfc( ^~ 1) , k = 0, 1, 2,...,0.5(A-1) (8.26) 

Note that for type 3 and type 4 (antisymmetric) sequences, we must also add a constant phase of 0.57T 
to <f>[k] (up to k = 0.5iV). The remaining samples of H[k] are found by conjugate symmetry. 

5. To minimize the Gibbs effect near discontinuities in H(F), we may allow the sample values to vary 
gradually between jumps (this is a design guideline). This is equivalent to introducing a finite transition 
width. The choice of the sample values in the transition band can affect the response dramatically. 


EXAMPLE 8.4 (FIR Filter Design by Frequency Sampling) 

(a) Consider the design of a lowpass filter shown in Figure E8.4(a). Let us sample the ideal H(F) (shown 
dark) over 0 < F < 1, with N = 10 samples. The magnitude of the sampled sequence H[k] is 

\H[k]\ = {l, 1, 1, 0, 0, ^ 0, 0, 1, 1} 

k =5 

The actual (phase-shifted) sequence is H[k\ = \H[k\\e^^- k \ where 

(j)[k\ = _7rk ^ ~ ^ = -0.9t irk, k< 5 

Note that H[k] must be conjugate symmetric about k = 0.5 N = 5, with H[k] = H*[N — k\. 

Now, H[k] = 0, k = 4,5,6, 7, and the remaining samples are H [0] = le j0 = 1 and 

H[l\ = le j4,[1] = e - j0 - 9n H[9} = H*[l}=e j0 - 9n H[2] = le j</,[3] = e~ jl ' 87r iJ[8] = FT [2] = e jl ' 8 * 

The inverse DFT of H[k] yields the symmetric real impulse response sequence hi[n], with 
hi[n\ = {0.0716, -0.0794, 0.1, 0.1558, 0.452, 0.452, 0.1558, 0.1, -0.0794, 0.0716} 

Its DTFT magnitude Hi(F), shown light in Figure E8.4(a), reveals a perfect match at the sampling 
points but has a large overshoot near the cutoff frequency. To reduce the overshoot, let us pick 

H[ 2] = 0.5e^I 2 ] = 0.5e -1 ' 8 ”’ H[ 8] = H*[ 2] = O.Se 1 - 8 ^ 

The inverse DFT of this new set of samples yields the new impulse response sequence h 2 [n]: 

h 2 [n} = {-0.0093, -0.0485, 0, 0.1867, 0.3711, 0.3711, 0.1867, 0, -0.0485, -0.0093} 

Its frequency response H 2 (F), in Figure E8.4(a), not only shows a perfect match at the sampling points 
but also a reduced overshoot, which we obtain at the expense of a broader transition width. 
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(a) Lowpass filter using frequency sampling 



Digital frequency F 


(b) Highpass filter using frequency sampling 



Digital frequency F 


Figure E8.4 Lowpass and highpass filters for Example 8.4 (a and b) 


(b) Consider the design of a highpass filter shown in Figure E8.4(b). Let us sample the ideal H(F ) (shown 
dark) over 0 < F < 1, with IV = 10 samples. The magnitude of the sampled sequence H[k] is 

|ff[fc]| = {0, 0, 0, 1, 1, 1, 1, 0, 0} 

k =5 

The actual (phase-shifted) sequence is H[k\ = \H[k] |e- 7< h[ fc ]. Si nC e the impulse response h[n] must be 
antisymmetric (for a highpass filter), 6 [k] includes an additional phase of 0.57T and is given by 

4>[k\ = -L-1 -I- 0.57T = 0.57T — 0.97rfc, k < 5 

Note that H[k] is conjugate symmetric about k = 0.5 N = 5, with H[k] = H*[N — k]. 

Now, H[k] = 0, k = 0,1,2, 8, 9, and if [5] = = l. The remaining samples are 

if [3] = le^ [3] = e~ j2 - 2 * H[7] = if* [3] = e j2 ' 2n if [4] = le^ [41 = H[6\ = H*[4\ = e j3A7r 

The inverse DFT of H[k] yields the antisymmetric real impulse response sequence h\ [n], with 

hi[n] = {0.0716, 0.0794, -0.1, -0.1558, 0.452, -0.452, 0.1558, 0.1, -0.0794, -0.0716} 

Its DTFT magnitude H\(F), shown light in Figure E8.4(b), reveals a perfect match at the sampling 
points but a large overshoot near the cutoff frequency. To reduce the overshoot, let us choose 

H[ 2] = 0.5e-^ 2 ] = 0.5e -1 ' 37r if [8] = 

The inverse DFT of this new set of samples yields the new impulse response sequence /12 [n]: 

h 2 [n) = {0.0128, -0.0157, -0.1, -0.0606, 0.5108, -0.5108, 0.0606, 0.1, 0.0157, -0.0128} 

Its frequency response H 2 (F), in Figure E8.4(b), not only shows a perfect match at the sampling points 
but also a reduced overshoot, which we obtain at the expense of a broader transition width. 
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8.5.1 Frequency Sampling and Windowing 

The frequency-sampling method can be used to design filters with arbitrary frequency-response shapes. 
We can even combine this versatility with the advantages of window-based design. Given the response 
specification H(F), we sample it at a large number of points M and find the IDFT to obtain the M-point 
impulse response h[n\. The choice M = 512 is not unusual. Since h[n) is unacceptably long, we truncate it 
to a smaller length N by windowing h[n\. The choice of window is based on the same considerations that 
apply to window-based design. If the design does not meet specifications, we can change N and/or adjust 
the sample values in the transition band and repeat the process. Naturally, this design is best carried out 
on a computer. The sample values around the transitions are adjusted to minimize the approximation error. 
This idea forms a special case of the more general optimization method called linear programming. But 
when it comes right down to choosing between the various computer-aided optimization methods, by far the 
most widely used is the equiripple optimal approximation method, which we describe in the next section. 


8.5.2 Implementing Frequency-Sampling FIR Filters 

We can readily implement frequency-sampling FIR filters by a nonrecursive structure, once we know the 
impulse response h[n\. We can even implement a recursive realization without the need for finding h[n\ , as 
follows. Suppose the frequency samples FGv[fc] of H(F) are approximated by an IV-point DFT of the filter 
impulse response /ijv[u]. We may then write 


N-l 


H N [k} = £ h N [n]e-* 2 ™ k ' N 


k =0 


Its impulse response ftjv[n] may be found using the inverse DFT as 


N-l 


h N[n } = ^ E H N [k\e^ nk / N 


(8.27) 


(8.28) 


k =0 


The filter transfer function H(z) is the z-transform of hjsj[n]: 


N-l 


N-l 


H ( z ) = E h N[n]z n = 


n—0 


n =0 


N-l 




J2ivnk/N 


k—0 


(8.29) 


Interchanging summations, setting 2 n e i 2vnk / N = [ z 1 e- 3 ’ 2 ' ,rfe / JV ] n , and using the closed form for the finite 
geometric sum, we obtain 


N-l 


H (*) = ^ E 


k—0 


The frequency response corresponding to H(z) is 


N-l 


H (F) = ^ E 


k =0 


1 -Z~ N 
1 _ z -l e j2irk/N 


l _ e -j2nFN 
1 _ e -j2n(F-k/N) 


(8.30) 


(8.31) 


If we factor out exp(—jnFN) from the numerator, exp[— jir(F — k/N)] from the denominator, and use Euler’s 
relation, we can simplify this result to 


N-l 

H{F) =E^ 

k—0 


smc[N(F *)] e- MN -i ){ F - k /N) = ^ HN [ k]w[F _ 
smc [(F-§)] ^ 


k—0 


(8.32) 
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Here, W[F — -|r] describes a sine interpolating function, defined by 

W \ F _ fcl = smc i N ( F - M -j„(N-l)(F-k/N) (n oox 

[ sinc[(F- A)] - ( ' 

and reconstructs H(F ) from its samples Hj^[k\ taken at intervals 1/N. It equals 1 when F = k/N, and zero 
otherwise. As a result, Hn(F) equals the desired H(F) at the sampling instants, even though Hn(F) could 
vary wildly at other frequencies. This is the concept behind frequency sampling. 

The transfer function H(z) may also be written as the product of two transfer functions: 


H{z) = H^H^z) 


ri-*-"] 

N—l 

H N [k] 

N 

k= 0 

1 _ Z ~1 e j2nk/N 


(8.34) 


This form of H(z) suggests a method of recursive implementation of FIR filters. We cascade a comb filter, 
described by Hi(z), with a parallel combination of N first-order resonators, described by F[- 2 {z). Note that 
each resonator has a complex pole on the unit circle and the resonator poles actually lie at the same locations 
as the zeros of the comb filter. Each pair of terms corresponding to complex conjugate poles may be combined 
to form a second-order system with real coefficients for easier implementation. 

Why implement FIR filters recursively? There are several reasons. In some cases, this may reduce the 
number of arithmetic operations. In other cases, it may reduce the number of delay elements required. Since 
the pole and zero locations depend only on N, such filters can be used for all FIR filters of length L by 
changing only the multiplicative coefficients. 

Even with these advantages, things can go wrong. In theory, the poles and zeros balance each other. 
In practice, quantization errors may move some poles outside the unit circle and lead to system instability. 
One remedy is to multiply the poles and zeros by a real number p slightly smaller than unity to relocate the 
poles and zeros. The transfer function then becomes 


H(z) 


1 - ( pz)~ N 

N 


N -1 

E 


k =0 


_ tfjy[fc] _ 

1 — (pz)~ 1 e : > 2nk / N 


(8.35) 


With p = 1 — e, typically used values for e range from 2 12 to 2 21 (roughly 10 4 to 10 9 ) and have been 
shown to improve stability with little change in the frequency response. 


8.6 Design of Optimal Linear-Phase FIR Filters 

Quite like analog filters, the design of optimal linear-phase FIR filters requires that we minimize the maximum 
error in the approximation. Optimal design of FIR filters is also based on a Chebyshev approximation. We 
should therefore expect such a design to yield the smallest filter length, and a response that is equiripple in 
both the passbancl and the stopband. A typical spectrum is shown in Figure 8.16. 

There are three important concepts relevant to optimal design: 

1. The error between the approximation H{F) and the desired response D{F) must be equiripple. The 
error curve must show equal maxima and minima with alternating zero crossings. The more the number 
of points where the error goes to zero (the zero crossings), the higher is the order of the approximating 
polynomial and the longer is the filter length. 
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Figure 8.16 An optimal filter has ripples of equal magnitude in the passband and stopband 


2. The frequency response H(F) of a filter whose impulse response h[n] is a symmetric sequence can 
always be put in the form 

M 

H(F ) = Q(F) a n cos(2t rnF) = Q{F)P{F) (8.36) 

n —0 

Here, Q(F) equals 1 (type 1), cos(7 tF) (type 2), sin(27rF) (type 3), or sin(7rF) (type 4); M is related 
to the filter length N with M = int(^^) (types 1, 2, 4) or M = int(^ 1 ^) (type 3); and the a n are 
related to the impulse response coefficients h[n\. The quantity P(F) may also be expressed as as a 
power series in cos(27tF) (or as a sum of Chebyshev polynomials). If we can select the a n to best meet 
optimal constraints, we can design H(F) as an optimal approximation to D(F). 

3. The alternation theorem offers the clue to selecting the a n . 

8.6.1 The Alternation Theorem 

We start by approximating D{F) by the Chebyshev polynomial form for H(F) and define the weighted 
approximation error e(F) as 

e(F) = W(F)[D{F) - H{F)} (8.37) 

Here, W ( F ) represents a set of weight factors that can be used to select different error bounds in the passband 
and stopband. The nature of D(F) and W(F) depends on the type of the filter required. The idea is to select 
the (in the expression for H(F)) so as to minimize the maximum absolute error |e| max . The alternation 
theorem points the way (though it does not tells us how). In essence, it says that we must be able to find at 
least M + 2 frequencies Fk , k = 1 , 2 ,..., M + 2 , called the extremal frequencies or alternations where 

1. The error alternates between two equal maxima and minima (extrema): 

e(F k ) = -e(F k+1 ), k = 1,2,..., M + 1 (8.38) 

2. The error at the frequencies F) c equals the maximum absolute error: 

|e(F fc )| = |e(F)| max , k = 1, 2,..., M + 2 (8.39) 

In other words, we require M + 2 extrema (including the band edges) where the error attains its maximum 
absolute value. These frequencies yield the smallest filter length (number of coefficients c*k) for optimal 
design. In some instances, we may get M + 3 extremal frequencies leading to so called extra ripple filters. 
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The design strategy to find the extremal frequencies invariably requires iterative methods. The most 
popular is the algorithm of Parks and McClellan, which in turn relies on the so-called Remez exchange 
algorithm. 

The Parks-McClellan algorithm requires the band edge frequencies F p and F s , the ratio K = 6 P /6 S of the 
passband and stopband ripple, and the filter length N. It returns the coefficients otk and the actual design 
values of S p and S s for the given filter length N. If these values of S p and S s are not acceptable (or do not 
meet requirements), we can increase N (or change the ratio K ), and repeat the design. 

A good starting estimate for the filter length N is given by a relation similar to the Kaiser relation for 
half-band filters, and reads 


-101og(^)-13 _ 10^/20 - i 

14.6F t p l(FV 2 o + 1 


<5 S 


1q -A 5 /20 


(8.40) 


Here, Fj- is the digital transition width. More accurate (but more involved) design relations are also available. 

To explain the algorithm, consider a lowpass filter design. To approximate an ideal lowpass filter, we 
choose D(F) and W(F) as 


D(F) 


1, 0 < F < F p 

0, F s < F < 0.5 


W(F) 


1, 0 < F < F p 

K = 6 P /5 S , F s < F < 0.5 


(8.41) 


To find the otk in H(F ), we use the Remez exchange algorithm. Here is how it works. We start with 
a trial set of M + 2 frequencies Fk , k = 1,2 ,M + 2. To force the alternation condition, we must satisfy 
e(-Ffc) = — e(Fk +i ),k = 1,2,..,,M + 1. Since the maximum error is yet unknown, we let p = e(Ffc) = 
—e(Ffe + i). We now have M + 1 unknown coefficients a.k and the unknown p , a total of M + 2. We solve for 
these by using the M + 2 frequencies, to generate the M + 2 equations: 


-(-1 ) k p=W(F k )[D(F k )-H(F k )], k = 1,2,..., M + 2 (8.42) 

Here, the quantity (—l) fc brings out the alternating nature of the error. 

Once the Ofc are found, the right-hand side of this equation is known in its entirety and is used to 
compute the extremal frequencies. The problem is that these frequencies may no longer satisfy the alternation 
condition. So we must go back and evaluate a new set of ak and p, using the computed frequencies. We 
continue this process until the computed frequencies also turn out to be the actual extremal frequencies (to 
within a given tolerance, of course). 

Do you see why it is called the exchange algorithm? First, we exchange an old set of frequencies Fk for 
a new one. Then we exchange an old set of ak for a new one. Since the ak and Fk actually describe the 
impulse response and frequency response of the filter, we are in essence going back and forth between the 
two domains until the coefficients ak yield a spectrum with the desired optimal characteristics. 

Many time-saving steps have been suggested to speed the computation of the extremal frequencies, and 
the Qfc, at each iteration. The Parks-McClellan algorithm is arguably one of the most popular methods 
of filter design in the industry, and many of the better commercial software packages on signal processing 
include it in their stock list of programs. Having said that, we must also point out two disadvantages of 
this method. First, the filter length must still be estimated by empirical means. And second, we have no 
control over the actual ripple that the design yields. The only remedy, if this ripple is unacceptable, is to 
start afresh with a different set of weight functions or with a different filter length. 


8.6.2 Optimal Half-Band Filters 

Since about half the coefficients of a half-banc! filter are zero, the computational burden can be reduced by 
developing a filter that contains only the nonzero coefficients followed by zero interpolation. To design a 
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half-band lowpass filter /ihb[«] with band edges F p and F s , and ripple 5 , an estimate of the filter length 
N = 4k — 1 is first found from the given design specifications. Next, we design a lowpass prototype hp[n\ of 
even length 0.5(iV + 1), with band edges of 2 F p and 0.5 (in effect, with no stopband). This filter describes 
a type 2 sequence whose response is zero at F = 0.5 and whose ripple is twice the design ripple. Finally, 
we insert zeros between adjacent samples of 0.5/ip[?r] and set the (zero-valued) center coefficient to 0.5 to 
obtain the required half-band filter TihbM with the required ripple. 


EXAMPLE 8.5 (Optimal FIR Filter Design) 

(a) We design an optimal bandstop filter with stopband edges of [2, 3] kHz, passband edges of [1, 4] kHz, 
A p = 1 dB, A s = 50 dB, and a sampling frequency of S = 10 kHz 

We find the digital passband edges as [0.2, 0.3] and the stopband edges as [0.1, 0.4]. 

The transition width is Fp = 0.1. We find the approximate filter length TV, as follows: 


(L = 


10A A P/ Z — 1 = 0.0575 6. = lO - ' 4 "/ 20 = 0.003 1 6 TV = 1 + 101og (W — 13 


10A./2O + i 


14.6F t 


17.7 


Choosing the next odd length gives TV = 19. The bandstop specifications are actually met by a filter 
with TV = 21. The response of the designed filter is shown in Figure E8.5(a). 



0 0.1 0.2 0.3 0.4 0.5 0 0.166 0.25 0.333 0.5 

Digital frequency F Digital frequency F 

Figure E8.5 Optimal filters for Example 8.5 (a and b) 


(b) (Optimal Half-Band Filter Design) We design an optimal half-banc! filter to meet the following 
specifications: 

Passband edge: 8 kHz, stopband edge: 16 kHz, A p = 1 dB, and A s = 50 dB. 

We choose S = 2 (f p + f s ) = 48 kHz. The digital band edges are F. p = 1, F s = |, and Fq = 0.25. 
Next, we find the minimum ripple S and the approximate filter length N as 


10A>/ 2 0 _ i 

d p = —-= 0.0575 

p 10A./20 + i 


<S. s = 10 ~ A ‘ /W = 0.00316 


(5 = 0.00316 


-10 log <5 2 - 13 - 20 log(0.00316) - 13 

+ 14.6 (F 3 -F p ) + 14.6(1/6) 


16.2 =>N= 19 
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The choice N = 19 is based on the form N = 4fc — 1. Next, we design the lowpass prototype hp[n] of 
even length M = 0.5 (N + 1) = 10 and band edges at 2 F p = 2(1/6) = 1/3 and F s = 0.5. The result is 

h P [n} = {0.0074, -0.0267, 0.0708, -0.173, 0.6226, 0.6226, -0.173, 0.0708, -0.0267, 0.0074} 

Finally, we zero-interpolate 0.5 hp[n\ and choose the center coefficient as 0.5 to obtain 7 /hb [u]: 

{0.0037,0,-0.0133,0,0.0354, 0,-0.0865,0, 0.3113, 0, 0.5, 0.3113,0,-0.0865,0,0.0354,0,-0.0133,0,0.0037} 

Its length is N = 19, as required. Figure E8.5(b) shows that this filter does meet specifications, with 
an attenuation of 0.02 dB at 8 kHz and 59.5 dB at 16 kHz. 


8.7 Application: Multistage Interpolation and Decimation 

Recall that a sampling rate increase, or interpolation, by N involves up-sampling (inserting N — 1 zeros 
between samples), followed by lowpass filtering with a gain of N. If the interpolation factor N is large, 
it is much more economical to carry out the interpolation in stages because it results in a smaller overall 
filter length or order. For example, if N can be factored as N = I 1 I 2 I 3 , then interpolation by N can be 
accomplished in three stages with individual interpolation factors of I\, I 2 , and I 3 . At a typical 7th stage, 
the output sampling rate is given by S ou t = as shown in Figure 8.17. 




Up-sample 

_ A 


't 

Rut =7S in 


Digital lowpass filter 


fs 


Sin-/p 

Gain = I 


S = 


X 


Figure 8.17 One stage of a typical multistage interpolating filter 

The filter serves to remove the spectral replications due to the zero interpolation by the up-sampler. These 
replicas occur at multiples of the input sampling rate. As a result, the filter stopband edge is computed 
from the input sampling rate Si n as f s = S\ n — f pi while the filter passband edge remains fixed (by the 
given specifications). The filter sampling rate corresponds to the output sampling rate ,S' out and the filter 
gain equals the interpolation factor /*,. At each successive stage (except the first), the spectral images occur 
at higher and higher frequencies, and their removal requires filters whose transition bands get wider with 
each stage, leading to less complex filters with smaller filter lengths. Although it is not easy to establish the 
optimum values for the interpolating factors and their order for the smallest overall filter length, it turns 
out that interpolating factors in increasing order generally yield smaller overall lengths, and any multistage 
design results in a substantial reduction in the filter length as compared to a single-stage design. 


EXAMPLE 8.6 (The Concept of Multistage Interpolation) 

(a) Consider a signal band-limited to 1.8 kHz and sampled at 4 kHz. It is required to raise the sampling 
rate to 48 kHz. This requires interpolation by 12. The value of the passband edge is f p = 1.8 kHz for 
either a single-stage design or multistage design. 

For a single-stage interpolator, the output sampling rate is S^ut = 48 kHz, and we thus require a filter 
with a stopband edge of f s = S[ n — f p = 4 — 1.8 = 2.2 kHz, a sampling rate of S = S out = 48 kHz, and 
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a gain of 12. If we use a crude approximation for the filter length as L « 4 /Ft, where Ft = ( fs~ fp)/S 
is the digital transition width, we obtain L = 4(48/0.4) = 480. 


(b) If we choose two-stage interpolation with I\ = 3 and / 2 = 4, at each stage we compute the important 
parameters as follows: 


Stage 

Sin 

(kHz) 

Interpolation 

Factor 

Sent = S 
(kHz) 

fp 

(kHz) 

fs = S in - fp 

(kHz) 

Filter Length 

L « 4S/(/ s - f p ) 

1 

4 

h = 3 

12 

1.8 

2.2 

48/0.4 = 120 

2 

12 

II 

48 

1.8 

10.2 

192/8.4= 23 


The total filter length is thus 143. 


(c) If we choose three-stage interpolation with I\ = 2, I 2 = 3, and J 3 = 2, at each stage we compute the 
important parameters, as follows: 


Stage 

Sin 

(kHz) 

Interpolation 

Factor 

Sent = S 
(kHz) 

fp 

(kHz) 

fs = Sin - fp 

(kHz) 

Filter Length 

L « 4S/(/ s - f p ) 

1 

4 

h =2 

8 

1.8 

2.2 

32/0.4 =80 

2 

8 

h = 3 

24 

1.8 

6.2 

96/4.4 = 22 

3 

24 

CM 

II 

48 

1.8 

22.2 

192/20.4 = 10 


The total filter length is thus 112. 


(d) If we choose three-stage interpolation but with the different order I\ = 3, 1 2 = 2, and I 3 = 2, at each 
stage we compute the important parameters, as follows: 


Stage 

Sin 

(kHz) 

Interpolation 

Factor 

Sent = S 
(kHz) 

fp 

(kHz) 

fs = S in ^ fp 
(kHz) 

Filter Length 

L « 4S/(/ s - f p ) 

1 

4 

h = 3 

12 

1.8 

2.2 

48/0.4 = 120 

2 

12 

II 

to 

24 

1.8 

10.2 

96/8.4 = 12 

3 

24 

II 

to 

48 

1.8 

22.2 

192/20.4= 10 


The total filter length is thus 142. 

Any multistage design results in a substantial reduction in the filter length as compared to a single-stage 
design, and a smaller interpolation factor in the first stage of a multistage design does seem to yield smaller 
overall lengths. Also remember that the filter lengths are only a crude approximation to illustrate the relative 
merits of each design and the actual filter lengths will depend on the attenuation specifications. 


For multistage operations, the actual filter lengths depend not only on the order of the interpolating 
factors, but also on the given attenuation specifications A p and A s . Since attenuations in decibels add in 
a cascaded system, the passband attenuation A p is usually distributed among the various stages to ensure 
an overall attenuation that matches specifications. The stopband specification needs no such adjustment. 
Since the signal is attenuated even further at each stage, the overall stopband attenuation always exceeds 
specifications. For interpolation, we require a filter whose gain is scaled (multiplied) by the interpolation 
factor of the stage. 
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EXAMPLE 8.7 (Design of Interpolating Filters) 

(a) Consider a signal band-limited to 1.8 kHz and sampled at 4 kHz. It is required to raise the sampling 
rate to 48 kHz. The passband attenuation should not exceed 0.6 dB, and the minimum stopband 
attenuation should be 50 dB. Design an interpolation filter using a single-stage interpolator. 

The single stage requires interpolation by 12. The value of the passband edge is f p = 1.8 kHz. 
The output sampling rate is 5 ou t = 48 kHz, and we thus require a filter with a stopband edge of 
fs = S ln — fp = 4 — 1.8 = 2.2 kHz and a sampling rate of S = S out = 48 kHz. We ignore the filter gain 
of 12 in the following computations. To compute the filter length, we first find the ripple parameters 


10 ^ p / 20 _ 1 io 0 - 6 / 20 — 1 

5 p = io^p/20 + i = 10 o.6/20 + i = °- 0345 


d a = 10~^ /2 ° = 10~ 5O/2 ° = 0.00316 


and then approximate the length N by 

Ar _ —101og(<5p(S s ) - 13 , 1 _ S[-101og((VS s ) - 13] , 1 oon 
14.6(F S — F p ) +1 ~ 14.6(/ s — f p ) + 1 - 230 

The actual filter length of the optimal filter turns out to be N = 233, and the filter shows a passband 
attenuation of 0.597 dB and a stopband attenuation of 50.05 dB. 


(b) Repeat the design using a three-stage interpolator with I\ =2, I 2 — 3, and / 3 = 2. How do the results 
compare with those of the single-stage design? 

We distribute the passband attenuation (in decibels) equally among the three stages. Thus, A p = 0.2 dB 
for each stage, and the ripple parameters for each stage are 

1 qO.2/20 _ 1 

= 10 o. 2 / 2 O + 1 = °' 0115 = IO" 50720 = 0-00316 

For each stage, the important parameters and the filter length are listed in the following table: 


Stage 

«Si„ 

(kHz) 

Interpolation 

Factor 

S out = S 

(kHz) 

fp 

(kHz) 

fs = Sin - fp 

(kHz) 

Filter Length 

L 

1 

4 

^-1 

II 

to 

8 

1.8 

2.2 

44 

2 

8 

1-2 = 3 

24 

1.8 

6.2 

13 

3 

24 

CM 

II 

48 

1.8 

22.2 

7 


In this table, for example, we compute the filter length for the first stage as 

_ -101og(($p(5 s ) - 13 = S[-101og(J p ^) - 13] 

~ 14.6 (F s -F p ) + 14.6(/ s — f p ) 

The actual filter lengths of the optimal filters turn out to be 47 (with design attenuations of 0.19 dB 
and 50.31 dB), 13 (with design attenuations of 0.18 dB and 51.09 dB), and 4 (with design attenuations 
of 0.18 dB and 50.91 dB). The overall filter length is only 64. This is about four times less than the 
filter length for single-stage design. 
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8.7.1 Multistage Decimation 

Decimation by M involves lowpass filtering (with a gain of unity), followed by down-sampling (discarding 
M — 1 samples and retaining every Mth sample). The process is essentially the inverse of interpolation. 
If the decimation factor M is large, decimation in stages results in a smaller overall filter length or order. 
If M can be factored as M = DiD 2 D^, then decimation by M can be accomplished in three stages with 
individual decimation factors of £> 1 , £> 2 , and D 3 . At a typical stage, the output sampling rate is given by 
Sout = Si n /D, where D is the decimation factor for that stage. This is illustrated in Figure 8.18. 


Digital lowpass filter 
/s = Sout-/p S = S lr 
Gain = 1 



Down-sample 

kn 



r< _ _ 111 

out- o 


Figure 8.18 One stage of a typical multistage decimating filter 

The decimation filter has a gain of unity and operates at the input sampling rate £)„, and its stopband 
edge is computed from the output sampling rate as f s = S out — f p . At each successive stage (except the 
first), the transition bands get narrower with each stage. 

The overall filter length does depend on the order in which the decimating factors are used. Although it 
is not easy to establish the optimum values for the decimation factors and their order for the smallest overall 
filter length, it turns out that decimation factors in decreasing order generally yield smaller overall lengths, 
and any multistage design results in a substantial reduction in the filter length as compared to a single-stage 
design. 

The actual filter lengths also depend on the given attenuation specifications. Since attenuations in 
decibels add in a cascaded system, the passband attenuation A p is usually distributed among the various 
stages to ensure an overall value that matches specifications. 


EXAMPLE 8.8 (The Concept of Multistage Decimation) 

(a) Consider a signal band-limited to 1.8 kHz and sampled at 48 kHz. It is required to reduce the sampling 
rate to 4 kHz. This requires decimation by 12. The passband edge is f p = 1.8 kHz and remains 
unchanged for a single stage-design or multistage design. 

For a single-stage decimator, the output sampling rate is S ou t = 4 kHz, and we thus require a filter with 
a stopband edge of f s = S ou _ t — f p = 4 — 1.8 = 2.2 kHz, a sampling rate of S = S- m = 48 kHz, and a gain 
of unity. If we use a crude approximation for the filter length as £ ss 4 /Ft, where Ft = (f s — f p )/S 
is the digital transition width, we obtain L = 48/0.4 = 120. 


(b) If we choose two-stage decimation with D\ = 4 and D 2 = 3, at each stage we compute the important 
parameters, as follows: 


Stage 

S in = S 
(kHz) 

Decimation 

Factor 

'Sout 

(kHz) 

fp 

(kHz) 

fs = S out - fp 
(kHz) 

Filter Length 

£ « 4 S/U, - f P ) 

1 

48 

£>i=4 

12 

1.8 

10.2 

192/8.4= 23 

2 

12 

D 2 — 3 

4 

1.8 

2.2 

48/0.4 = 120 
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The total filter length is thus 143. 


(c) If we choose three-stage decimation with D 3 = 2, D 2 = 3, and D 3 = 2, at each stage we compute the 
important parameters, as follows: 


Stage 

S in = S 
(kHz) 

Decimation 

Factor 

*$out 

(kHz) 

fp 

(kHz) 

fs = S out - fp 
(kHz) 

Filter Length 

L « 4 S/{fs - f P ) 

1 

48 

D x = 2 

24 

1.8 

22.2 

192/20.4 =10 

2 

24 

D 2 = 3 

8 

1.8 

6.2 

96/4.4 = 22 

3 

8 

D 3 = 2 

4 

1.8 

2.2 

32/0.4 =80 


The total filter length is thus 112. 


(d) If we choose three-stage decimation but with the different order D 3 = 2, D 2 = 2, and D 3 = 3, at each 
stage we compute the important parameters, as follows: 


Stage 

S in = S 
(kHz) 

Decimation 

Factor 

*$out 

(kHz) 

fp 

(kHz) 

fs = Sout - fp 
(kHz) 

Filter Length 

L « 4 S/{f s - f p ) 

1 

48 

D 3 = 2 

24 

1.8 

22.2 

192/20.4 = 10 

2 

24 

D 2 = 2 

12 

1.8 

10.2 

96/8.4 = 12 

3 

12 

D 3 = 3 

4 

1.8 

2.2 

48/0.4 = 120 


The total filter length is thus 142. 

Note how decimation uses the same filter frequency specifications as does interpolation for a given split, 
except in reversed order. Any multistage design results in a substantial reduction in the filter length as 
compared to a single-stage design. Also remember that the filter lengths chosen here are only a crude 
approximation (in order to illustrate the relative merits of each design), and the actual filter lengths will 
depend on the attenuation specifications. 


8.8 Maximally Flat FIR Filters 

Linear-phase FIR filters can also be designed with maximally flat frequency response. Such filters are 
usually used in situations where accurate filtering is needed at low frequencies (near dc). The design of 
lowpass maximally flat filters uses a closed form for the transfer function H(F ) given by 

H(F) = cos 2K (t tF) d n sin 2 n (nF) d n = ^ ~ ^ = C* +n ~ l (8.43) 

Here, the d n have the form of binomial coefficients as indicated. Note that 2L — 1 derivatives of \H(F)\' 2 
are zero at F = 0 and 2 K — 1 derivatives are zero at F = 0.5. This is the basis for the maximally flat 
response of the filter. The filter length equals N = 2(K + L) — 1, and is thus odd. The integers K and L 
are determined from the passband and stopband frequencies F p and F s that correspond to gains of 0.95 and 
0.05 (or attenuations of about 0.5 dB and 26 dB), respectively. Here is an empirical design method: 
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1. Define the cutoff frequency as Fc = 0.5(F p + F s ) and let Ft = F s — F p . 

2. Obtain a first estimate of the odd filter length as Nq = 1 + 0.5 /F^. 

3. Define the parameter a as a = cos 2 (ttFc). 

4. Find the best rational approximation a « K/M m i n , with 0.5(-/V o — 1) < M m i n < (iVo — 1). 

5. Evaluate L and the true filter length N from L = M m ; n — K and N = 2 M mlD — 1. 

6. Find h[n] as the .ZV-point inverse DFT of H(F), F = 0,1 /N ,..., (N — l)/iV. 


EXAMPLE 8.9 (Maximally Flat FIR Filter Design) 

Consider the design of a maximally flat lowpass FIR filter with normalized frequencies F p = 0.2 and F s = 0.4. 

We have Fc = 0.3 and Ft = 0.2. We compute N 0 = 1 + 0.5/i 7 ^ = 13.5 « 15, and a = cos 2 (nFc) = 0.3455. 
The best rational approximation to a works out to be a ~ 5/14 = K /M m ; n . 

With K = 5 and M m i n = 14, we get L = M m ; n — K = 9, and the filter length N = 2M m ; n — 1 = 27. 

Figure E8.9 shows the impulse response and \F[(F)\ of the designed filter. The response is maximally flat, 
with no ripples in the passband. 


S 

< 


(a) Impulse response h[n] 


..... .T 

T. ...... 

’ l (i 

[1 * 


(b) Magnitude spectrum in dB 




0 13 26 0 0.1 0.2 0.3 0.4 0.5 0 0.05 0.1 0.15 0.2 

DT index n Digital frequency F Digital frequency F 

Figure E8.9 Features of the maximally flat lowpass filter for Example 8.9 


8.9 FIR Differentiators and Hilbert Transformers 

An ideal digital differentiator is described by H(F) = j^irF, |F| < 0.5. In practical situations, we seldom 
require filters that differentiate for the full frequency range up to |F| = 0.5. If we require differentiation only 
up to a cutoff frequency of Fc, then 


H(F)=j2nF, \F\<F C 


(8.44) 


The magnitude and phase spectrum of such a differentiator are shown in Figure 8.19. Since H(F) is odd, 
h[0] = 0. To find h[n ], n/ 0 we use the inverse DTFT to obtain 


h[n] = j 


rFc 


2t iFe j2n7vF dF 


' —Fc 


(8.45) 
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Figure 8.19 Magnitude and phase spectrum of an ideal differentiator 


Invoking Euler’s relation and symmetry, this simplifies to 

. i . f Fc „ . 2mrFccos(2mrFc) — sm(2mrFc) 

h[n] = -4?r / Fsin 2n7rF dF = --- v ^^ 

Jo 


COSl TL7T ) 

For Fc = 0.5 , this yields h[0] = 0 and h[n] — -, n yf 0. 


8.9.1 Hilbert Transformers 

A Hilbert transformer is used to shift the phase of a signal by — ^ (or —90°) over the frequency range 
|.F| < 0.5. In practice, we seldom require filters that shift the phase for the full frequency range up to 
|A| = 0.5. If we require phase shifting only up to a cutoff frequency of Fc, the Hilbert transformer may be 
described by 

H{F) = -j sgn(F), \F\ < F c (8.47) 

Its magnitude and phase spectrum are shown in Figure 8.20. 



Figure 8.20 Magnitude and phase spectrum of an ideal Hilbert transformer 


With h[0] = 0, we use the inverse DTFT to find its impulse response h[n], n / 0, as 

h[n] = [ FC -jsgn(F)e j2n7rF dF = 2 sm(2nnF ) dF = 1 ~ cos(2n 7 rF 1 c ) ( 8 . 48 ) 

J-F C Jo ™ 

1 — COSl 717T) 

For Fc = 0.5, this reduces to h\n\ = -, n / 0. 

mr 

8.9.2 Design of FIR Differentiators and Hilbert Transformers 

To design an FIR differentiator, we must truncate h[n] to h^[n] and choose a type 3 or type 4 sequence, since 
H(F) is purely imaginary. To ensure odd symmetry, the filter coefficients may be computed only for n > 0, 
and the same values (in reversed order) are used for n < 0. If N is odd, we must also include the sample 
h[0]. We may window /ijv[n] to minimize the overshoot and ripple in the spectrum F[jy(F). And, finally, 
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to ensure causality, we must introduce a delay of (N — l)/2 samples. Figure 8.21(a) shows the magnitude 
response of Hamming-windowed FIR differentiators for both even and odd lengths N. Note that H( 0) is 
always zero, but H( 0.5) = 0 only for type 3 (odd-length) sequences. 



Digital frequency F 



0 0.1 0.2 0.3 0.4 0.5 

Digital frequency F 


Figure 8.21 Magnitude spectra of ideal differentiators and Hilbert transformers 


The design of Hilbert transformers closely parallels the design of FIR differentiators. The sequence h[n] 
is truncated to ftjv[n]. The chosen filter must correspond to a type 3 or type 4 sequence, since H(F) is 
imaginary. To ensure odd symmetry, the filter coefficients may be computed only for n > 0, with the same 
values (in reversed order) used for n < 0. If N is odd, we must also include the sample /i[0]. We may window 
hisr[n} to minimize the ripples (due to the Gibbs effect) in the spectrum Hn(F). The Hamming window is a 
common choice, but others may also be used. To make the filter causal, we introduce a delay of (N — l)/2 
samples. The magnitude spectrum of a Hilbert transformer becomes flatter with increasing filter length N. 
Figure 8.21(b) shows the magnitude response of Hilbert transformers for both even and odd lengths N. Note 
that -ff(O) is always zero, but H{ 0.5) = 0 only for type 3 (odd-length) sequences. 


8.10 Least Squares and Adaptive Signal Processing 

The concept of least squares can be formulated as the solution to a set of algebraic equations expressed in 
matrix form as 

Xb = Y (8.49) 

If the number of unknowns equals the number of equations, and the matrix X is non-singular such that its 
inverse X^ 1 exists (the unique case), the solution is simply b = X _1 Y. However, if the number of equations 
exceeds the number of unknowns (the over-determined case), no solution is possible, and only an approximate 
result may be obtained using, for example, least squares minimization. If the number of unknowns exceeds 
the number of equations (the under-determined case), many possible solutions exist, including the one where 
the mean square error is minimized. 

In many practical situations, the set of equations is over-determined and thus amenable to a least-squares 
solution. To solve for b, we simply premultiply both sides by X T to obtain 

X T Xb = X t Y (8.50) 

If the inverse of X T X exists, the solution is given by 

b = (X 7 X)' x X 7 Y (8.51) 
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The matrix X 7 X is called the covariance matrix. 

8.10.1 Adaptive Filtering 

The idea of least squares finds widespread application in adaptive signal processing, a field that includes 
adaptive filtering, deconvolution, and system identification, and encompasses many disciplines. Typically, 
the goal is to devise a digital filter whose coefficients b[k\ can be adjusted to optimize its performance (in 
the face of changing signal characteristics or to combat the effects of noise, for example). A representative 
system for adaptive filtering is shown in Figure 8.22. The measured signal x[n\ (which may be contaminated 
by noise) is fed to an FIR filter whose output y[n] is compared with the desired signal y[n] to generate 
the error signal e[n]. The error signal is used to update the filter coefficients &[fc] through an adaptation 
algorithm in a way that minimizes the error e[n], and thus provides an optimal estimate of the desired signal 

y[n\- 



e[n] 


Figure 8.22 The structure of a typical adaptive filtering system 


In convolution form, the output Y of the (M + l)-point adaptive FIR filter is described by the model 


M 


y[n] = E b[k\x[n — k], n = 0,l,...,M + N + l 


k =o 


This set of M + N + 1 equations may be cast in matrix form as 




’ *[0] 

0 




*[1] 

*[0] 

0 

y[o] 


®N 

x[l] 

*[0] 

y[N] . 


x[N] 

0 

x[N — 1] 

x[N 



0 

0 




0 

0 

0 


x[N — M] 


m 

b[M] 


(8.52) 


(8.53) 


In vector notation, it has the form Y = Xb, where b is an (M +1) x 1 column matrix of the filter coefficients 
6[0] through b[M), Y is an (A I + N + 1) x 1 matrix of the output samples, and X is an (M + N + 1) x ( M + 1) 
Toeplitz (constant diagonal) matrix whose columns are successively shifted replicas of the input sequence. 
The (M + 1) filter coefficients in b are chosen to ensure that the output Y of the model provides an optimal 
estimate of the desired output Y. Clearly, this problem is amenable to a least squares solution. 

Since the data is being acquired continuously in many practical situations, the least squares solution 
is implemented on-line or in real time using iterative or recursive numerical algorithms. Two common ap- 
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proaches are the recursive least squares (RLS) algorithm and the least mean squares (LMS) algorithm. 
Both start with an assumed set of filter coefficients and update this set as each new input sample arrives. 

The RLS algorithm: In the RLS algorithm, the filter coefficients are updated by weighting the input 
samples (typically in an exponential manner) so as to emphasize more recent inputs. 

The LMS algorithm: The LMS algorithm, though not directly related to least squares, uses the so-called 
method of steepest descent to generate updates that converge about the least squares solution. Although it 
may not converge as rapidly as the RLS algorithm, it is far more popular due to its ease of implementation. 
In fact, the updating equation (for the nth update) has the simple form 

b n [k] = b n -i[k] + 2 p(y[n] — y[n])x[n — fc] = b n -i[k] + 2 pe[n\x[n — k], 0 < k < M (8.54) 

The parameter p governs both the rate of convergence and the stability of the algorithm. Larger values 
result in faster convergence, but the filter coefficients tend to oscillate about the optimum values. Typically, 
p is restricted to the range 0 < p < —, where o x , the variance of x[n], provides a measure of the power in 
the input signal x[n}. 

8.10.2 Applications of Adaptive Filtering 

Adaptive filtering forms the basis for many signal-processing applications including system identification, 
noise cancellation, and channel equalization. We conclude with a brief introduction. 

System Identification 

In system identification, the goal is to identify the transfer function (or impulse response) of an unknown 
system. Both the adaptive filter and the unknown system are excited by the same input, and the signal y[n] 
represents the output of the unknown system. Minimizing e[n\ implies that the output of the unknown system 
and the adaptive filter are very close, and the adaptive filter coefficients describe an FIR approximation to 
the unknown system. 

Noise Cancellation 

In adaptive noise-cancellation systems, the goal is to improve the quality of a desired signal y[n\ that may 
be contaminated by noise. The signal x[n] is a noise signal, and the adaptive filter minimizes the power in 
e[n]. Since the noise power and signal power add (if they are uncorrelated), the signal e[n] (with its power 
minimized) also represents a cleaner estimate of the desired signal y[n\. 

Channel Equalization 

In adaptive channel equalization, the goal is to allow a modem to adapt to different telephone lines (so as to 
prevent distortion and inter-symbol interference). A known training signal y[n\ is transmitted at the start 
of each call, and x[?r] is the output of the telephone channel. The error signal e[n] is used to generate an 
FIR filter (an inverse system) that cancels out the effects of the telephone channel. Once found, the filter 
coefficients are fixed, and the modem operates with the fixed filter. 
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8.1 (Symmetric Sequences) Find H(z) and H(F) for each sequence and establish the type of FIR filter 
it describes by checking values of H(F) at F = 0 and F = 0.5. 

(a) h[n] = {1,0, 1} (b) h[n] = (l, 2,2,1} 

(c) h[n] = {1,0, -1} (d) h[n] = {-1, 2, -2, 1} 

8.2 (Symmetric Sequences) What types of sequences can we use to design the following filters? 

(a) Lowpass (b) Highpass (c) Bandpass (d) Bandstop 

8.3 (Linear-Phase Sequences) The first few values of the impulse response sequence of a linear-phase 
filter are h[n\ = {2, —3, 4, 1,...}. Determine the complete sequence, assuming the smallest length for 
h[n ], if the sequence is to be: 

(a) Type 1 (b) Type 2 (c) Type 3 (d) Type 4 

[Hints and Suggestions: For part (a), the even symmetry will be about the fourth sample. Part (c) 
requires odd length, odd symmetry and a zero-valued sample at the midpoint.] 

8.4 (Linear Phase and Symmetry) Assume a finite length impulse response sequence h[n] with real 
coefficients and argue for or against the following statements. 

(a) If all the zeros lie on the unit circle, h[n\ must be linear phase. 

(b) If h[n] is linear phase its zeros must always lie on the unit circle. 

(c) If h[n\ is odd symmetric, there must be an odd number of zeros at z = 1. 

[Hints and Suggestions: Use the following facts. Each pair of reciprocal zeros, such as (z — a) 
and (z — 1/a), yields an even symmetric impulse response of the form {l,/3,1}. Multiplication in 
the z-domain means convolution in the time-domain. The convolution of symmetric sequences is also 
symmetric.] 

8.5 (Linear Phase and Symmetry) Assume a linear-phase sequence h[n] with real coefficients and 
refute the following statements by providing simple examples using zero locations only at 2 = ±1. 

(a) If h[n] has zeros at z = — 1 it must be a type 2 sequence. 

(b) If h[n] has zeros at z = —1 and z = 1, it must be a type 3 sequence. 

(c) If h[n) has zeros at 2 = 1 it must be a type 4 sequence. 

8.6 (Linear Phase and Symmetry) The locations of the zeros at z = ±1 and their number provides 

useful clues about the type of a linear-phase sequence. What is the sequence type for the following 
zero locations at z = ±1? Other zero locations are in keeping with linear phase and real coefficients. 

(a) No zeros at z = ±1 

(b) One zero at 2 = —1, none at z = 1 

(c) Two zeros at z = —1, one zero at z = 1 

(d) One zero at 2 = 1, none at z = — 1 

(e) Two zeros at z = 1, none at z = —1 

(f) One zero at z = 1, one zero at z = — 1 
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(g) Two zeros at z = 1, one zero at 2 " = —1 

[Hints and Suggestions: For (a), the length is odd and the symmetry is even (so, type 1). For the 
rest, each zero increases the length by one and each zero at z = 1 toggles the symmetry.] 

8.7 (Linear-Phase Sequences) What is the smallest length linear-phase sequence with real coefficients 
that meets the requirements listed? Identify all the zero locations and the type of linear-phase sequence. 


( a ) 

(b) 

(c) 

(d) 


Zero location: 
Zero location: 
Zero location: 
Zero location: 


z = e-? 0 ' 2 , even symmetry; odd length 

z = Offie? 0 ' 2577 ; even symmetry; even length 
2 = e i o.25tt. 0( ] ( ] symmetry; even length 
z = Offie? 0 ' 2577 ; odd symmetry; odd length 


[Hints and Suggestions: For (a) and (c), the given zero will be paired with its conjugate. For (b) 
and (d), the given zero will be part of a conjugate reciprocal quadruple. For all parts, no additional 
zeros give an odd length and even symmetry. Each additional zero at z = 1 or x = -1 will increase 
the length by one. Each zero at 2 = 1 will toggle the symmetry.] 

8.8 (Linear-Phase Sequences) Partial details of various filters are listed. Zero locations are in keeping 
with linear phase and real coefficients. Assuming the smallest length, identify the sequence type and 
find the transfer function of each filter. 

(a) Zero location: z = Offie? 0 ' 2577 

(b) Zero location: z = e? 0 ' 2577 

(c) Zero locations: z = 1, z = e? 02577 

(d) Zero locations: 2 = 0.5, 2 = —1; odd symmetry 

(e) Zero locations: 2 = 0.5, z = 1, z = —1; even symmetry 


[Hints and Suggestions: Linear phase requires conjugate reciprocal zeros. No zeros at z = 1 yield 
even symmetry. Each additional zero at z = 1 toggles the symmetry.] 

8.9 (Truncation and Windowing) Consider a windowed lowpass FIR filter with cutoff frequency 5 kHz 
and sampling frequency S = 20 kHz. Find the truncated, windowed sequence, the minimum delay (in 
samples and in seconds) to make the filter causal, and the transfer function H(z) of the causal filter if 

(a) N = 7, and we use a Bartlett window. 

(b) N = 8, and we use a von Hann (Hanning) window. 

(c) N = 9, and we use a Hamming window. 


[Hints and Suggestions: For (a)-(b), find the results after discarding any zero-valued end-samples 
of the windowed sequence.] 

8.10 (Spectral Transformations) Assuming a sampling frequency of 40 kHz and a fixed passband, find 
the specifications for a digital lowpass FIR prototype and the subsequent spectral transformation to 
convert to the required filter type for the following filters. 

(a) Highpass: passband edge at 10 kHz, stopband edge at 4 kHz 

(b) Bandpass: passband edges at 6 kHz and 10 kHz, stopband edges at 2 kHz and 12 kHz 

(c) Bandstop: passband edges 8 kHz and 16 kHz, stopband edges 12 kHz and 14 kHz 
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[Hints and Suggestions: For (b)-(c), ensure arithmetic symmetry by relocating some band edges 
(assuming a fixed passband, for example) to maintain the smallest transition width.] 

8.11 (Window-Based FIR Filter Design) We wish to design a window-based linear-phase FIR filter. 
What is the approximate filter length N required if the filter to be designed is 

(a) Lowpass: f p = 1 kHz, f s = 2 kHz, S = 10 kHz, using a von Hann (Hanning) window? 

(b) Highpass: f p = 2 kHz, f s = 1 kHz, S = 8 kHz, using a Blackman window? 

(c) Bandpass: f p = [4,8] kHz, f s = [2,12] kHz, S = 25 kHz, using a Hamming window? 

(d) Bandstop: f p = [2,12] kHz, f s = [4,8] kHz, S = 25 kHz, using a Hamming window? 

[Hints and Suggestions: This requires table lookup and the digital transition width. Round up the 
length to the next highest integer (an odd integer for bandstop filters). ] 

8.12 (Half-Band FIR Filter Design) A lowpass half-band FIR filter is to be designed using a von Hann 
window. Assume a filter length iV = 11 and find its windowed, causal impulse response sequence and 
the transfer function H(z) of the causal filter. 

8.13 (Half-Band FIR Filter Design) Design the following half-band FIR filters, using a Kaiser window. 

(a) Lowpass filter: 3-dB frequency 4 kHz, stopband edge 8 kHz, and A s = 40 dB. 

(b) Highpass filter: 3-dB frequency 6 kHz, stopband edge 3 kHz, and A s = 50 dB. 

(c) Bandpass filter: passband edges at [2, 3] kHz, stopband edges at [1, 4] kHz, A p = 1 clB, and 
A s = 35 dB. 

(d) Bandstop filter: stopband edges at [2, 3] kHz, passband edges at [1, 4] kHz, A p = 1 clB, and 
A s = 35 dB. 

[Hints and Suggestions: For (a)-(b), pick S = 2 (f p + f s ) and Fc = 0.25. For (b), design a Kaiser 
lowpass prototype h[n] to get /;hp[u] = (—1 ) n h{n\. For (c)-(d), design a lowpass prototype h[n] with 
S = 4/ 0 , Fc = 0.5 (F p + F a ). Then, /ibp[u] = 2cos(0.5?r7r)/i[?r] and ftesN = <5[n] — 2cos(0.5ri7r)/i[n]. 
You will need to compute the filter length N (an odd integer), the Kaiser parameter /3, and values of 
the TV-sample Kaiser window for each part.] 

8.14 (Frequency-Sampling FIR Filter Design) Consider the frequency-sampling design of a lowpass 
FIR filter with F c = 0.25. 

(a) Sketch the gain of an ideal filter with Fq = 0.25. Pick eight samples over the range 0 < F < 1 
and set up the sampled frequency response H[k] of the filter assuming a real, causal h[n\. 

(b) Compute the impulse response h[n] for the filter. 

(c) To reduce the overshoot, modify H[ 3] and recompute h[n]. 

[Hints and Suggestions: For (a), set | H[k] [ = {1,1,1,0,0,0,1,1} and find H[k] = | H[k\ | e J C[fc] w h 6 re 
k = 0,1, 2,..., 7, H[k\ = H*[N — k\ and </>[k\ = — 1) /N for a real and causal h[n]. For (b), 

find h[n] as the IDFT. For (c), pick |R[3]| = 0.5 and H[ 3] = 0.5e?^[ 3 I and H[ 5] = R*[3].] 

8.15 (Maximally Flat FIR Filter Design) Design a maximally flat lowpass FIR filter with normalized 
frequencies F p = 0.1 and F s = 0.4, and find its frequency response H(F). 

8.16 (FIR Differentiators) Find the impulse response of a digital FIR differentiator with 

(a) N = 6, cutoff frequency Fc = 0.4, and no window. 

(b) N = 6, cutoff frequency Fc = 0.4, and a Hamming window. 
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(c) N = 5, cutoff frequency Fq = 0.5, and a Hamming window. 

[Hints and Suggestions: For (a)-(b), N = 6 and so n = —2.5, —1.5, —0.5,0.5,1.5,2.5.] 

8.17 (FIR Hilbert Transformers) Find the impulse response of an FIR Hilbert transformer with 

(a) N = 6, cutoff frequency Fq = 0.4, and no window. 

(b) N = 6, cutoff frequency Fq = 0.4, and a von Hann window. 

(c) N = 7, cutoff frequency Fq = 0.5, and a von Hann window. 

[Hints and Suggestions: For (a)-(b), N = 6 and so n = —2.5, —1.5, —0.5,0.5,1.5,2.5.] 

8.18 (IIR Filters and Linear Phase) Even though HR filters cannot be designed with linear phase, it 
is possible to implement systems containing IIR filters to eliminate phase distortion. A signal x[n] is 
folded and passed through a filter H(F ), and the filter output is then folded to obtain the signal y\ [n]. 
The signal x[n] is also passed directly through the filter H{F) to get the signal 2/2 N- The signals y-\ [n] 
and 2/2 [n] are summed to obtain the overall output y[n\. 

(a) Sketch a block diagram of this system. 

(b) How is Y(F) related to X{F )1 

(c) Does the system provide freedom from phase distortion? 

[Hints and Suggestions: If h[n] <t=> H(F), then h[—n ] <t=> H(—F). Also, H{F) + F[{—F) is purely 
real.] 

8.19 (Filter Specifications) A hi-fi audio signal band-limited to 20 kHz is contaminated by high-frequency 
noise between 70 kHz and 110 kHz. We wish to design a digital filter that reduces the noise by a factor 
of 100 while causing no appreciable signal loss. One way is to design the filter at a sampling rate that 
exceeds the Nyquist rate. However, we can also make do with a smaller sampling rate that avoids 
aliasing of the noise spectrum into the signal spectrum. Pick such a sampling rate and develop the 
frequency and attenuation specifications for the digital filter. 

[Hints and Suggestions: The image of the aliased noise spectrum does not overlap the signal spec¬ 
trum as long as it lies between 20 kHz and 70 kHz.] 

8.20 (FIR Filter Specifications) Figure P8.20 shows the magnitude and phase characteristics of a causal 
FIR filter designed at a sampling frequency of 10 kHz. 



.30 I_lit I M I I I I I I I I II 

0 0.15 0.3 0.5 



O'--‘-' 

0 0.1 0.3 0.5 



0 0.15 0.3 0.5 


Digital frequency F Digital frequency F Digital frequency F 

Figure P8.20 Filter characteristics for Problem 8.20 


(a) What are the values of the passband ripple S p and stopband ripple S s ? 

(b) What are the values of the attenuation A s and A p in decibels? 
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(c) What are the frequencies (in Hz) of the passband edge and stopband edge? 

(d) Does this filter show linear phase? What is the group delay? 

(e) What is the filter length N7 

(f) Could this filter have been designed using the window method? Explain. 

(g) Could this filter have been designed using the optimal method? Explain. 

[Hints and Suggestions: The dB magnitude gives S s and F s . The linear magnitude gives 6 P and F p . 
The slope of the phase plot gives the delay as D = — 2 £af ( an integer). For part (e), N = 2D + 1. 
The size of the stopband and passband ripples provides a clue to parts (f)-(g).] 

8.21 (Multistage Interpolation) It is required to design a three-stage interpolator. The interpolating 
filters are to be designed with identical passband and stopband attenuation and are required to provide 
an overall attenuation of no more than 3 dB in the passband and at least 50 dB in the stopband. Specify 
the passband and stopband attenuation of each filter. 


COMPUTATION AND DESIGN 


8.22 (FIR Filter Design) It is desired to reduce the frequency content of a hi-fi audio signal band-limited 
to 20 kHz and sampled at 44.1 kHz for purposes of AM transmission. Only frequencies up to 10 kHz 
are of interest. Frequencies past 15 kHz are to be attenuated by at least 55 dB, and the passband loss 
is to be less than 10%. Design a digital filter using the Kaiser window that meets these specifications. 

8.23 (FIR Filter Design) It is desired to eliminate 60-Hz interference from an ECG signal whose signif¬ 
icant frequencies extend to 35 Hz. 

(a) What is the minimum sampling frequency we can use to avoid in-band aliasing? 

(b) If the 60-Hz interference is to be suppressed by a factor of at least 100, with no appreciable signal 
loss, what should be the filter specifications? 

(c) Design the filter using a Hamming window and plot its frequency response. 

(d) Test your filter on the signal x(t) = cos(407rf) + cos(707rf) + cos(1207rf). Plot and compare the 
frequency response of the sampled test signal and the filtered signal to confirm that your design 
objectives are met. 

8.24 (Digital Filter Design) We wish to design a lowpass filter for processing speech signals. The 
specifications call for a passband of 4 kHz and a stopband of 5 kHz. The passband attenuation is to 
be less than 1 dB, and the stopband gain is to be less than 0.01. The sampling frequency is 40 kHz. 

(a) Design FIR filters, using the window method (with Hamming and Kaiser windows) and using 
optimal design. Which of these filters has the minimum length? 

(b) Design HR Butterworth and elliptic filters, using the bilinear transformation, to meet the same 
set of specifications. Which of these filters has the minimum order? Which has the best delay 
characteristics? 

(c) How does the complexity of the HR filters compare with that of the FIR filters designed with 
the same specifications? What are the trade-offs in using an HR filter over an FIR filter? 

8.25 (The Effect of Group Delay) The nonlinear phase of HR filters is responsible for signal distortion. 
Consider a lowpass filter with a 1-dB passband edge at f p = 1 kHz, a 50-dB stopband edge at f p = 
2 kHz, and a sampling frequency of S = 10 kHz. 
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(a) Design a Butterworth filter Hb(z), an elliptic filter He(z ), and an optimal FIR filter Ho{z) to 
meet these specifications. Using the Matlab routine grpdelay (or otherwise), compute and plot 
the group delay of each filter. Which filter has the best (most nearly constant) group delay in 
the passband? Which filter would cause the least phase distortion in the passband? What are 
the group delays Nb , Ne, and No (expressed as the number of samples) of the three filters? 

(b) Generate the signal x[n] = 3sin(0.03n7r) + sin(0.09?r7r) + 0.6 sin(0.15n7r) over 0 < n < 100. Use 
the ADSP routine filter to compute the response ys[n], 2 /_e[u], and yo[n} of each filter. Plot the 
filter outputs j/s[?r], 2 /s[n], and yo[n\ (delayed by Nb, Ne, and Nq, respectively) and the input 
x[n] on the same plot to compare results. Which filter results in the smallest signal distortion? 

(c) Are all the frequency components of the input signal in the filter passband? If so, how can you 
justify that what you observe as distortion is actually the result of the non-constant group delay 
and not the filter attenuation in the passband? 


8.26 (Raised Cosine Filters) 


The impulse response of a raised cosine filter has the form 


h R [n\ = h[n] 


cos(2nnRFc ) 
1 - (4nRF c ) 2 


where the roll-off factor R satisfies 0 < R < 1 and h[n] = 2Fc sinc(2ni 7 c) is the impulse response of 
an ideal lowpass filter. 

(a) Let Fc = 0.2. Generate the impulse response of an ideal lowpass filter with length 21 and 
the impulse response of the corresponding raised cosine filter with R = 0.2, 0.5, 0.9. Plot the 
magnitude spectra of each filter over 0 < F < 1 on the same plot, using linear and decibel scales. 
How does the response in the passband and stopband of the raised cosine filter differ from that 
of the ideal filter? How does the transition width and peak sidelobe attenuation of the raised 
cosine filter compare with that of the ideal filter for different values of R ? What is the effect of 
increasing R on the frequency response? 

(b) Compare the frequency response of h R [n] with that of an ideal lowpass filter with Fq = 0.25. Is 
the raised cosine filter related to this ideal filter? 


8.27 (Interpolation) The signal x[n] = cos(27rFon) is to be interpolated by 5, using up-sampling followed 
by lowpass filtering. Let F 0 = 0.4. 

(a) Generate and plot 20 samples of x[n ] and up-sample by 5. 

(b) What must be the cutoff frequency Fq and gain A of a lowpass filter that follows the up-sampler 
to produce the interpolated output? 

(c) Design an FIR filter (using the window method or optimal design) to meet these specifications. 

(d) Filter the up-sampled signal through this filter and plot the result. 

(e) Is the filter output an interpolated version of the input signal? Do the peak amplitude of the 
interpolated signal and original signal match? Should they? Explain. 

8.28 (Multistage Interpolation) To relax the design requirements for the analog reconstruction filter, 
many compact disc systems employ oversampling during the DSP stages. Assume that audio signals 
are band-limited to 20 kHz and sampled at 44.1 kHz. Assume a maximum passband attenuation of 1 
dB and a minimum stopband attenuation of 50 dB. 

(a) Design a single-stage optimal interpolating filter that increases the sampling rate to 176.4 kHz. 

(b) Design multistage optimal interpolating filters that increase the sampling rate to 176.4 kHz. 

(c) Which of the two designs would you recommend? 
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(d) For each design, explain how you might incorporate compensating filters during the DSP stage 
to offset the effects of the sine distortion caused by the zero-order-hold reconstruction device. 

8.29 (Multistage Interpolation) The sampling rate of a speech signal band-limited to 3.4 kHz and 
sampled at 8 kHz is to be increased to 48 kHz. Design three different schemes that will achieve this 
rate increase and compare their performance. Use optimal FIR filter design where required and assume 
a maximum passband attenuation of 1 dB and a minimum stopband attenuation of 45 dB. 

8.30 (Multistage Decimation) The sampling rate of a speech signal band-limited to 3.4 kHz and sampled 
at 48 kHz is to be decreased to 8 kHz. Design three different schemes that will achieve this rate decrease 
and compare their performance. Use optimal FIR filter design where required and assume a maximum 
passband attenuation of 1 dB and a minimum stopband attenuation of 45 dB. How do these filters 
compare with the filters designed for multistage interpolation in Problem 20.28. 

8.31 (Filtering Concepts) This problem deals with time-frequency plots of a combination of sinusoids 
and their filtered versions. 

(a) Generate 600 samples of the signal x[n] = cos(0.1n7r) + cos(0.4n7r) + cos(0.7?r7r) comprising the 
sum of three pure cosines at F = 0.05, 0.2, 0.35. Use the Matlab command f ft to plot its DFT 
magnitude. Use the routine timefreq (from the author’s website) to display its time-frequency 
plot. What do the plots reveal? Now design an optimal lowpass filter with a 1-dB passband edge 
at F = 0.1 and a 50-dB stopband edge at F = 0.15 and filter x[n] through this filter to obtain 
the filtered signal Xf[n]. Plot its DFT magnitude and display its time-frequency plot. What do 
the plots reveal? Does the filter perform its function? Plot x / [n] over a length that enables you 
to identify its period. Does the period of x / [n] match your expectations? 

(b) Generate 200 samples each of the three signals yi[n] = cos(0.1n7r), yzln] = cos(0.4n7r), and 
2 / 3 M = cos(0.7n7r). Concatenate them to form the 600-sample signal y[n] = {y\[n}, 3 / 2 M> VsVA}- 
Plot its DFT magnitude and display its time-frequency plot. What do the plots reveal? In what 
way does the DFT magnitude plot differ from part (a)? In what way does the time-frequency 
plot differ from part (a)? Use the optimal lowpass filter designed in part (a) to filter y[n], obtain 
the filtered signal y /[n], plot its DFT magnitude, and display its time-frequency plot. What do 
the plots reveal? In what way does the DFT magnitude plot differ from part (a)? In what way 
does the time-frequency plot differ from part (a)? Does the filter perform its function? Plot 
yf[n\ over a length that enables you to identify its period. Does the period of y /[n] match your 
expectations? 

8.32 (Decoding a Mystery Message) During transmission, a message signal gets contaminated by a 
low-frequency signal and high-frequency noise. The message can be decoded only by displaying it in 
the time domain. The contaminated signal x[n\ is provided on the author’s website as mysteryl .mat. 
Load this signal into Matlab (use the command load mysteryl). In an effort to decode the message, 
try the following methods and determine what the decoded message says. 

(a) Display the contaminated signal. Can you “read” the message? Display the DFT of the signal 
to identify the range of the message spectrum. 

(b) Design an optimal FIR bandpass filter capable of extracting the message spectrum. Filter the 
contaminated signal and display the filtered signal to decode the message. Use both the filter 
(linear-phase filtering) and filtfilt (zero-phase filtering) commands. 

(c) As an alternative method, first zero out the DFT component corresponding to the low-frequency 
contamination and obtain its IDFT y[n\. Next, design an optimal lowpass FIR filter to reject the 
high-frequency noise. Filter the signal y[n] and display the filtered signal to decode the message. 
Use both the filter and filtfilt commands. 
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(d) Which of the two methods allows better visual detection of the message? Which of the two 
filtering routines (in each method) allows better visual detection of the message? 

8.33 (Filtering of a Chirp Signal) This problem deals with time-frequency plots of a chirp signal and 
its filtered versions. 

(a) Generate 500 samples of a chirp signal x[n\ whose frequency varies from F = 0 to F = 0.12. 
Then, compute its DFT and plot the the DFT magnitude. Use the routine timefreq (from the 
author’s website) to display its time-frequency plot. What do the plots reveal? Plot x[n] and 
confirm that its frequency is increasing with time. 

(b) Design an optimal lowpass filter with a 1-dB passband edge at F — 0.04 and a 40-dB stopband 
edge at F = 0.1 and use the Matlab command f iltf ilt to obtain the zero-phase filtered signal 
y-\ [n]. Plot its DFT magnitude and display its time-frequency plot. What do the plots reveal? 
Plot j/i [n] and x[n] on the same plot and compare. Does the filter perform its function? 

(c) Design an optimal highpass filter with a 1-dB passband edge at F = 0.06 and a 40-dB stopband 
edge at F = 0.01 and use the Matlab command f iltf ilt to obtain the zero-phase filtered 
signal 2/2 N- Plot its DFT magnitude and display its time-frequency plot. What do the plots 
reveal? Plot 1/2 [n] and x[n] on the same plot and compare. Does the filter perform its function? 

8.34 (Filtering of a Chirp Signal) This problem deals with time-frequency plots of a chirp signal and 
a sinusoid and its filtered versions. 

(a) Generate 500 samples of a signal x[n\ that consists of the sum of cos(0.6?r7r) and a chirp whose 
frequency varies from F = 0 to F = 0.05. Then, compute its DFT and plot the DFT magnitude. 
Use the routine psdwelch (from the author’s website) to display its power spectral density plot. 
Use the routine timefreq (from the author’s website) to display its time-frequency plot. What 
do the plots reveal? 

(b) Design an optimal lowpass filter with a 1 dB passband edge at F = 0.08 and a 40-dB stopband 
edge at F = 0.25 and use the Matlab command f iltf ilt to obtain the zero-phase filtered 
signal 2/1 [n]. Plot its DFT magnitude and display its PSD and time-frequency plot. What do the 
plots reveal? Plot 2/1 [n]. Does it look like a signal whose frequency is increasing with time? Do 
the results confirm that the filter performs its function? 

(c) Design an optimal highpass filter with a 1-dB passband edge at F = 0.25 and a 40-dB stopband 
edge at F = 0.08 and use the Matlab command f iltf ilt to obtain the zero-phase filtered 
signal 2/2 [u]. Plot its DFT magnitude and display its PSD and time-frequency plot. What do the 
plots reveal? Plot 2/2 [n]. Does it look like a sinusoid? Can you identify its period from the plot? 
Do the results confirm that the filter performs its function? 

8.35 (A Multi-Band Filter) A requirement exists for a multi-band digital FIR filter operating at 140 Hz 
with the following specifications: 

Passband 1: from dc to 5 Hz 

Maximum passband attenuation = 2 dB (from peak) 

Minimum attenuation at 10 Hz = 40 dB (from peak) 

Passband 2: from 30 Hz to 40 Hz 

Maximum passband attenuation = 2 dB (from peak) 

Minimum attenuation at 20 Hz and 50 Hz = 40 dB (from peak) 

(a) Design the first stage as an odd-length optimal filter, using the routine firpm (from the author’s 
website). 
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(b) Design the second stage as an odd-length half-band filter, using the routine firhb (from the 
author’s website) with a Kaiser window. 

(c) Combine the two stages to obtain the impulse response of the overall filter. 

(d) Plot the overall response of the filter. Verify that the attenuation specifications are met at each 
design frequency. 
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Chapter 9 


DESIGN OF HR FILTERS 


9.0 Scope and Objectives 

This chapter begins with an introduction to HR filters, and the various mappings that are used to con¬ 
vert analog filters to digital filters. It then describes the design of HR digital filters based on an analog 
lowpass prototype that meets the given specifications, followed by an appropriate mapping and spectral 
transformation. The bilinear transformation and its applications are discussed in detail. 


9.1 Introduction 

Typical magnitude and phase specifications for HR filters are identical to those for FIR filters. Digital filter 
design revolves around two distinctly different approaches. If linear phase is not critical, HR filters yield a 
much smaller filter order for a given application. The design starts with an analog lowpass prototype based 
on the given specifications. It is then converted to the required digital filter, using an appropriate mapping 
and an appropriate spectral transformation. A causal, stable HR filter can never display linear phase for 
several reasons. The transfer function of a linear-phase filter must correspond to a symmetric sequence and 
ensure that H(z) = ±H{—l/z). For every pole inside the unit circle, there is a reciprocal pole outside the 
unit circle. This makes the system unstable (if causal) or noncausal (if stable). To make the infinitely long 
symmetric impulse response sequence of an HR filter causal, we need an infinite delay, which is not practical, 
and symmetric truncation (to preserve linear phase) simply transforms the HR filter into an FIR filter. 


9.2 HR Filter Design 

There are two related approaches for the design of HR digital filters. A popular method is based on using 
methods of well-established analog filter design, followed by a mapping that converts the analog filter to the 
digital filter. An alternative method is based on designing the digital filter directly, using digital equivalents 
of analog (or other) approximations. Any transformation of an analog filter to a digital filter should ideally 
preserve both the response and stability of the analog filter. In practice, this is seldom possible because of 
the effects of sampling. 

9.2.1 Equivalence of Analog and Digital Systems 

The impulse response hit) of an analog system may be approximated by 

OO OO 

h{t) « h a (t) = t s ^2 h(t)5(t — nt s ) = t s ^ h(nt s )5(t — nt s ) (9.1) 

71— — 00 71— — OO 
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Here, t s is the sampling interval corresponding to the sampling rate S = l/t s . The discrete-time impulse 
response h s [n] describes the samples h{nt s ) of h(t) and may be written as 

OO 

h s [n] = h{nt s ) = Y^ h s [k\6[n— k] (9.2) 

k=— oo 

The Laplace transform H a {s) of h a (t) and the ^-transform Hd(z) of h s [n] are 

OO OO 

H{s) « H a (s) = t s Y h{kt s )e~ skts H d {z) = Y h sW~ k (9.3) 

k— —oo k=— oo 

Comparison suggests the equivalence H a (s ) = t s Hd{z) provided z~ k = e _sfct % or 

z => e sts s=>\n(z)/t s (9.4) 

These relations describe a mapping between the variables 2 and s. Since s = a + ju) , where u> is the 
continuous frequency, we can express the complex variable z as 

z _ g (<T+jU>)ts _ e <Tt Se juit s _ e <Tt Se jn 

Here, f 1 = cot a = 2nf/S = 2itF is the digital frequency in radians/sample. 

The sampled signal h s [n\ has a periodic spectrum given by its DTFT: 

OO 

H P (f) = S Y — kS) 

k=— oo 

If the analog signal h(t) is band-limited to B and sampled above the Nyquist rate (S > 2B), the principal 
period (—0.5 < F < 0.5) of H p {f) equals SH{f), a scaled version of the true spectrum H(f). We may thus 
relate the analog and digital systems by 

H(f)=t a H p (f) or H a (s)\ s = j2 ir f ^t a H d {z)\ x= ^ f/ a, \f\< 0.55 (9.7) 

If S < 2B, we have aliasing, and this relationship no longer holds. 

9.2.2 The Effects of Aliasing 

The relations 2 => e sts and s =>• ln(z) /t s do not describe a one-to-one mapping between the s-plane and the 
z-plane. Since is periodic with period 2i r, all frequencies Ho ± 2kn (corresponding to wo ± ku > s , where 
l o s = 2irS) are mapped to the same point in the z-plane. A one-to-one mapping is thus possible only if 
H lies in the principal range — n < H < tt (or 0 < H < 2i r), corresponding to the analog frequency range 
—0.5cu s < ui < 0.5w s (or 0 < u> < u> s ). Figure 9.1 illustrates how the mapping z => e sts translates points in 
the s-domain to corresponding points in the z-domain. 

The origin: The origin s = 0 is mapped to z = 1, as are all other points corresponding to s = 0 ± jkui s for 
which z = e jku ^ = e jfc27r = 1. 

The jw-axis: For points on the jcu-axis, a = 0, z = e jf2 , and |z| = 1. Asw increases from wo to + u> s , 
the frequency H increases from Ho to Ho + 27 t, and segments of the jw-axis of length u> s = 2itS thus map to 
the unit circle, over and over. 


(9.5) 


(9.6) 
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The s-plane origin is mapped to z = 1. 

Segments of the jco-axis of length co s 
are mapped to the unit circle. 

Strips of width co s in the LHP are mapped 
to the interior of the unit circle. 



Figure 9.1 Characteristics of the mapping z =>■ exp(sG) 


The left half-plane: In the left half-plane, a < 0. Thus, 2 = e ats eJ a or \z\ = e ats < 1. This describes the 
interior of the unit circle in the 2 -plane. In other words, strips of width u> s in the left half of the s-plane are 
mapped to the interior of the unit circle, over and over. 

The right half-plane: In the right half-plane, o > 0, and we see that \z\ — e ats > 1. Thus, strips of width 
u s in the right half of the s-plane are repeatedly mapped to the exterior of the unit circle. 


REVIEW PANEL 9.1 

The Mapping z => e sts Is Not a Unique One-to-One Mapping 

Strips of width co s = 2ttS (along the jw-axis) in the left half of the s-plane map to the interior of the unit 
circle, over and over. 


9.2.3 Practical Mappings 

The transcendental nature of the transformation s => In {z)/t 3 does not permit direct conversion of a rational 
transfer function H{s) to a rational transfer function H(z). Nor does it permit a one-to-one correspondence 
for frequencies higher than 0.5S' Hz. A unique representation in the 2 -plane is possible only for band-limited 
signals sampled above the Nyquist rate. Practical mappings are based on one of the following methods: 

1. Matching the time response (the response-invariant transformation) 

2. Matching terms in a factored H(s) (the matched 2 -transform) 

3. Conversion of system differential equations to difference equations 

4. Rational approximations for 2 => e sts or s => ln( 2 ) /t s 

In general, each method results in different mapping rules, and leads to different forms for the digital 
filter H{z) from a given analog filter H{s), and not all methods preserve stability. When comparing the 
frequency response, it is helpful to remember that the analog frequency range 0 < / < OAS for the frequency 
response of H(s) corresponds to the digital frequency range 0 < F < 0.5 for the frequency response of H(z). 
The time-domain response can be compared only at the sampling instants t = nt 3 . 


9.3 Response Matching 

The idea behind response matching is to match the time-domain analog and digital response for a given 
input, typically the impulse response or step response. Given the analog filter ff(s), and the input x(t) 
whose invariance we seek, we first find the analog response y(t) as the inverse transform of H(s)X(s). We 
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then sample x(t) and y(t) at intervals t s to obtain their sampled versions x[n\ and y[n). Finally, we compute 
H(z) = Y(z)/X(z) to obtain the digital filter. The process is illustrated in Figure 9.2. 


Input x(t) 


Sample . 

/ x\n\ 

t = nt s 


X(s) => Y(s)=X(s)H(s) => y(t) 


Sample 
t = nt s 


> 


y[n] 


X(z) 


=> Y(z) 




H(z)= 


m 

X(Z) 


Figure 9.2 The concept of response invariance 


Response-invariant matching yields a transfer function that is a good match only for the time-domain 
response to the input for which it was designed. It may not provide a good match for the response to other 
inputs. The quality of the approximation depends on the choice of the sampling interval t s , and a unique 
correspondence is possible only if the sampling rate S = l/t s is above the Nyquist rate (to avoid aliasing). 
This mapping is thus useful only for analog systems such as lowpass and bandpass filters, whose frequency 
response is essentially band-limited. This also implies that the analog transfer function H(s) must be strictly 
proper (with numerator degree less than the denominator degree). 


Response-Invariant Mappings Ma 

The response y(t) of H(s) matches the 

REVIEW PANEL 9.2 

tch the Time Response 

response y[n] of H(z) at tl: 

of the Analog and Digital Filter 

ie sampling instants t = nt s . 



EXAMPLE 9.1 (Response-Invariant Mappings) 


(a) Convert H(s ) = - to a digital filter H(z ), using impulse invariance, with t s = Is. 

s + 1 

For impulse invariance, we select the input as x(t) = S(t). We then find 

X{s) = 1 Y(s) = H(s)X(s) = — y(t) = e~ t u(t) 

s + 1 

The sampled versions of the input and output are 

= y[ n \ = e~ nts u[n} 

Taking the ratio of their ^-transforms and using t s = 1, we obtain 

H(z) = = y(z) = Z = Z = _-_ 

X(z) z — e ts z — e 1 z — 0.3679 

The frequency response of H(s ) and H(z) is compared in Figure E9.1(a). 
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0 0.1 0.2 0.3 0.4 0.5 


(b) Magnitude after gain matching at dc 



0 0.1 0.2 0.3 0.4 0.5 


Analog frequency / [Hz] Analog frequency / [Hz] 

Figure E9.1 Frequency response of H(s) and H(z) for Example 9.1(a) 


The dc gain of H(s ) (at s = 0) is unity, but that of H(z) (at z = 1) is 1.582. Even if we normalize the 
dc gain of H{z) to unity, as in Figure E9.1(b), we see that the frequency response of the analog and 
digital filters is different. However, the analog impulse response h(t) = e~ t matches h[n\ = e~ n u[n) at 
the sampling instants t = nt s = n. A perfect match for the time-domain response, for which the filter 
was designed, lies at the heart of response invariant mappings. The time-domain response to any other 
inputs will be different. For example, the step response of the analog filter is 


S(s) 


1 

s(s + 1) 


1 1 
s s + 1 


s(f) = (1 — e *)u(t) 


To find the step response S(z) of the digital filter whose input is u[n] <t=> z/(z — 1), we use partial 
fractions on S(z)/z to obtain 


S(z) = 


ze/(e — 1) z/{ 1 — e) 


( z-l)(z-e !) 


2-1 


z — e~ 


s\n\ =- T u \ n \ 

e — 1 


1 — e 


The sampled version of s(t) is quite different from s[n\. Figure E9.1A reveals that, at the sampling 
instants t = nt s , the impulse response of the two filters shows a perfect match, but the step response 
does not, and neither will the time-domain response to any other input. 



0 2 4 6 

DT index n and time t=nt 


(b) Step response of analog and digital filter 



DT index n and time t=nt 

s 


Figure E9.1A Impulse response and step response of H(s) and H(z) for Example 9.1(a) 


(b) Convert H(s ) = --r to H(z ), using various response-invariant transformations. 

(s + l)(s + 2) 


1. Impulse invariance: We choose x(t) = S(t). Then, X(s) = 1, and 

4 4 4 


E( S ) = H(s)X(s) = 


(5 + 1)(5 T 2) s + 1 5 + 2 


y(t) = 4e t u(i) — 4e 2t u(t) 
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The sampled input and output are then 


x[n] = £>[n] 


y[n\ = 4e nts u[n] — 4e 2nts u[n} 


The ratio of their ^-transforms yields the transfer function of the digital filter as 

Y(z) v/' / \ 4z 4z 

X(z) z-e-*> z — e~ 2ta 

2. Step invariance: We choose x(t) = u(t). Then, X(s) = 1/s, and 

y <*> = = s(s + l)(s + 2) = ; - 7TT + JT2 »<‘> = < 2 “ 4e ~‘ + 

The sampled input and output are then 


a;[n] = u[n] 


y[n] = (2 - 4e- nts + 2 e~ M ')u[n] 


Their ^-transforms give 


X(z) = 


Y(z) = 


2 z 4 z 2z 

-i-zf 4-: 

z —l z — e ts z — e 


The ratio of their ^-transforms yields the transfer function of the digital filter as 

R Y {z) 0 4(z — 1) 2(z — 1) 

3. Ramp invariance: We choose x(t) = r(t) = tu(t). Then, X(s) = 1/s 2 , and 


F(s) = 


4 _ -3 2 4 1 

s 2 (s + l)(s + 2) s + s 2 + s+l s + 2 


y(t) = (— 3 + 2t + 4e — e *)u(t) 


The sampled input and output are then 


x[n] = nt s u[n\ 


y[n\ = (—3 + 2 nt s + 4e nta — e nts )u[n] 


Their ^-transforms give 


X(z) = 


(z-iy 


Y(z) = —+ 2zts + — _£_ 

v ' z — 1 (z — l) 2 z — e~ ts z — e~ 2ts 


The ratio of their ^-transforms yields the transfer function of the digital filter as 

JJ ^(Z — l ) 2 (Z — l ) 2 

R * t s t s (z — e~ ts ) t s (z-e~ 2t °) 


©Ashok Ambardar, September 1, 2003 





368 


Chapter 9 Design of HR Filters 


9.3.1 The Impulse-Invariant Transformation 


The impulse-invariant mapping yields some useful design relations. We start with a first-order analog filter 
described by H(s ) = l/(s + p). The impulse response h(t), and its sampled version h[n], are 

h(t ) = e~ pt u{t) h[n\ = e~ pnts u[n] = (e~ pts ) n u[n] (9.8) 

The 2 -transform of h[n\ (which has the form a"it[n], where a = e~ pts ), yields the transfer function H(z) of 
the digital filter as 


H{z) = - Z —, \z\ > e~ pts 

z — e pts 

This relation suggests that we can go directly from H(s) to H(z), using the mapping 

1 ^ 

s + p z — e~ pts 


(9.9) 


(9.10) 


We can now extend this result to filters of higher order. If H(s) is in partial fraction form, we can obtain 
simple expressions for impulse-invariant mapping. If H(s) has no repeated roots, it can be described as a sum 
of first-order terms, using partial fraction expansion, and each term can be converted by the impulse-invariant 
mapping to give 


N 


= E 


Ah 


k =1 


Pk 


H{z) = 


zA k 


N 

y _ 

t ^ % — g Pk^s 

k=l 


ROC: \z I > e 


“bln 


(9.11) 


Here, the region of convergence of H(z) is in terms of the largest pole magnitude |p| m ax of H(s). 



REVIEW PANEL 9.3 


Impulse-Invariant Design Requires H(s) in Partial Fraction Form 

I _^ 2 

(for each term in the partial fraction expansion) 

s + p k z — e~ Pkts 


If the denominator of H(s ) also contains repeated roots, we start with a typical kth term H k (s) with a 
root of multiplicity M, and find 

Ak , A k 


H k (s) = 


(s + Pk) 


M 


h k (t ) = 


(M — 1)! 


M—l -p k t 


u(t) 


(9.12) 


The sampled version h k {n\, and its ^-transform, can then be found by the times-n property of the 2 -transform. 
Similarly, quadratic terms corresponding to complex conjugate poles in H(s) may also be simplified to obtain 
a real form. These results are listed in Table 9.1. Note that impulse-invariant design requires H(s) in partial 
fraction form and yields a digital filter H(z) in the same form. It must be reassembled if we need a composite 
rational function form. The left half-plane poles of H(s ) (corresponding to p k > 0) map into poles of H(z) 
that lie inside the unit circle (corresponding to 2 = e~ Pkts < 1). Thus, a stable analog filter H(s ) is 
transformed into a stable digital filter H(z). 


REVIEW PANEL 9.4 

Impulse-Invariant Mappings Are Prone to Aliasing but Preserve Stability 

The analog impulse response h(t) matches h[n] at the sampling instants. 
Impulse-invariant mappings are not suitable for highpass or bandstop filter design. 
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Table 9.1 Impulse-Invariant Transformations 


Term 

Form of H(s ) 

H(z) (with a = e pts ) 

Distinct 

A 

A 2 

( s + p ) 

(2-a) 

Complex conjugate 

Ae jn Ae~ jn 

| 

22 2 Acos(fl) — 2Aa2cos(fi + gf s ) 

s + p + jq s + p- jq 

2 2 — 2az cos(qt s ) + a 2 

Repeated twice 

A 


(s + p ) 2 

Ats (z-aY 

Repeated thrice 

A 

n 5 i t 2 az ( z + a ) 

(s + p ) 3 

(*_ a )3 


EXAMPLE 9.2 (Impulse-Invariant Mappings) 

4s + 7 

(a) Convert H(s ) = „- to H(z), using impulse invariance at S = 2 Hz. 

s- + 5s + 4 

First, by partial fractions, we obtain 

4s + 7 4s+ 7 _ 3 1 

s 2 + 5s + 4 (s + 1) (s + 4) s + 4^"s + l 

The impulse-invariant transformation, with t s = 1/S = 0.5 s, gives 

3z z 3 z 


H(s) = 


H(z) = 


z — e 


-its 


z — e 


z — e~ 


z _ 4z 2 - 1.95492 

2 - e-°- 5 “ 2 2 - 0.74192+ 0.0821 


(b) Convert H(s ) = 


(s + l)(s 2 + 4s + 5) 
The partial fraction form for H(s) is 


to H(z), using impulse invariance, with t s = 0.5 s. 


H ( S ) = A+ + 1 3 ' 1+J 


s+1 s + 2 + j s + 2 - j 

For the second term, we write K = (—1 — j) = v / 2e _: ' 3 ’ 1 ’/ 4 = Ae Thus, A = \/2 and fl = —3tt/4. 
We also have p = 2, q= 1, and a = e~ pts = 1/e. With these values, Table 9.1 gives 


H(z) = 


2 2 2\f2z 1 cos(—^f) — 2\/2(2/e)cos(0.5 — ^f-) 


This result simplifies to 


2 - 1/y/e. 


H(z) = 


2 2 — 2(2/e)cos(0.5) + e -2 


0.21462 2 + 0.09302 
2 3 - 1.25222 2 + 0.52702 - 0.0821 


Comment: The first step involved partial fractions. Note that we cannot compute H(z) as the cascade 

4 1 

of the impulse-invariant digital filters for Hi(s ) = —— and i? 2 (s) = - 


s + 1 


s 2 + 4s + 5 
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9.3.2 Modifications to Impulse-Invariant Design 

Gain Matching 

The mapping H(s ) = l/(s + Pk) => H{z) = 2/(2 — e~ Pkts ) reveals that the dc gain of the analog term H{s) 
(with s = 0) equals 1/pk but the dc gain of the digital term H(z) (with z = 1) is 1/(1 — e~ Pkt ”). If the 
sampling interval t s is small enough such that pkt s <C 1, we can use the approximation e~ Pkt “ « 1 — p k t s 
to give the dc gain of H(z) as 1 /pkt s . This suggests that the transfer function H{z) must be multiplied by 
t s in order for its dc gain to closely match the dc gain of the analog filter H(s). This scaling is not needed 
if we normalize (divide) the analog frequency specifications by the sampling frequency S before designing 
the digital filter, because normalization is equivalent to choosing t s = 1 during the mapping. In practice, 
regardless of normalization, it is customary to scale H(z) to KH(z), where the constant K is chosen to 
match the gain of H(s ) and KH(z) at a convenient frequency (typically, dc). Since the scale factor also 
changes the impulse response of the digital filter from h[n] to Kh[n], the design is now no longer strictly 
impulse invariant. 


REVIEW PANEL 9.5 

Gain Matching at dc in Impulse-Invariant Design 

Design H(z) from H(s), compute K = H(s)\ s =o/H(z) z =i and multiply H(z) by K. 


Accounting for Sampling Errors 

The impulse-invariant method suffers from errors in sampling h(t) if it shows a jump at t = 0. If h{ 0) is 
not zero, the sampled value at the origin should be chosen as 0.5ft.(0). As a result, the impulse response 
of the digital filter must be modified to /im[«] = h[n] — 0.5/i(0)<5[n]. This leads to the modified transfer 
function Hm{z ) = H(z) — 0.5/i(0). The simplest way to find h( 0) is to use the initial value theorem 
h( 0) = lim^oo sH(s). Since h( 0) is nonzero only if the degree N of the denominator of H(s ) exceeds the 
degree M of its numerator by 1, we need this modification only if N — M = 1. 


EXAMPLE 9.3 (Modified Impulse-Invariant Design) 
(a) (Impulse-Invariant Design) 


Convert the analog filter H(s ) = 


s + 1 


, with a cutoff frequency of 1 rad/s, to a digital filter with a 


cutoff frequency of f c = 10 Hz and S = 60 Hz, using impulse invariance and gain matching. 


There are actually two ways to do this: 


1. We normalize by the sampling frequency S, which allows us to use t s — 1 in all subsequent 
computations. Normalization gives flc = 2nfc/S = |. We denormalize H(s) to He to get 




7r 

_3_ 

S + 


7r 

3 


Finally, with t 3 = 1, impulse invariance gives 


Hi{z) 



1.04722 
2 - 0.3509 
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2. We first denormalize H(s ) to fc to get 


H 2 {s) = H 



20tt 

s + 207r 


We use impulse invariance and multiply the resulting digital filter transfer function by t s to get 

207T2 2§ 1.04722 

2 s z — e~ 207Tts 2 — e -7r / 3 2 — 0.3509 


Comment: Both approaches yield identical results. The first method automatically accounts for the 
gain matching. For a perfect gain match at dc, we should multiply H(z) by the gain factor 


K = 


1 

m 


1 - 0.3509 
1.0472 


0.6198 


(b) (Modified Impulse-Invariant Design) 


Convert H(s ) = 


1 


s + 1 


to a digital filter, with t s = 1 s, using modified impulse invariance to account 


for sampling errors and gain matching at dc. 

Using impulse invariance, the transfer function of the digital filter is 

H{z) = 2 


2 — e - 


2 - 0.3679 


Since h(t) = e t u(t ), h(t) has a jump of 1 unit at t = 0, and thus h( 0) = 1. The modified impulse- 
invariant mapping thus gives 


H m (z) = H{z ) - 0.5/i(0) 



0.5(2 Te" 1 ) 
2 — e -1 


0.5(2 + 0.3679) 
2 - 0.3679 


The dc gain of H(s) is unity. We compute the dc gain of H(z) and Hm(z) (with 2 = 1) as 

1 


H(z )\ z =i = 


1 — e~ 


= 1.582 H m {z)\z= i = 0-5 ? + e _., = 1.082 

1 — e 1 


For unit dc gain, the transfer functions of the original and modified digital filter become 

2 0.6321 2 0.5(2 Te" 1 ) 0.4621(2 + 0.3679) 

l(2) ~ 1.582(2 - e” 1 ) ~ 2 - 0.3679 ~ 1.082(2 - e" 1 ) ~ 2 - 0.3679 

Figure E9.3B compares the response of H(s), H(z), Hi(z), Hm(z), and Hmi(z). It clearly reveals 
the improvement due to each modification. 
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Impulse-invariant design for H(s ) = 1/(5+1) (dashed) 



(c) (Modified Impulse-Invariant Design) 


Convert the analog filter H(s) = -- 

w . s 2 + 5s + 4 

invariance to account for sampling errors. 


to a digital filter, with t s 


0.5 s, using modified impulse 


Since the numerator degree is M — 1 and the denominator degree is N = 2, we have N — M = 1, and 
a modification is needed. The initial value theorem gives 


MO) 


lim sH(s) = lim 

s —>-oo s —>-oo 


4s 2 + 7 s 
s 2 + 5s + 4 


4 + 

1 + 5/s + 4/s 2 


The transfer function of the digital filter using impulse-invariant mapping was found in part (a) as 


H(z) 



z 


z — e -0 - 5 


The modified transfer function is thus 


H m {z ) = H(z) - 0.5/i(0) 




2z 2 - 0.4712z - 0.1642 
2 2 - 0.7419^ + 0.0821 


(d) (Modified Impulse-Invariant Design) 

4 

Convert H(s ) = 7 - . . „ ---- to a digital filter, with t s = 0.5 s, using modified impulse invari- 

(s + l)(s 2 + 4s + 5) 

ance (if required) to account for sampling errors. 

Since the numerator degree is M = 0 and the denominator degree is N = 3, we have N — M = 3. Since 
this does not equal 1, the initial value is zero, and no modification is required. The transfer function 
of the digital filter using impulse-invariant mapping is thus 

0.2146z 2 + 0.0930^ 

^ ~ z 3 - 1.2522z 2 + 0.52702 - 0.0821 
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9.4 The Matched z-Transform for Factored Forms 


The impulse-invariant mapping may be expressed as 

1 z 


s + a z — e 


s + a 


z — e 


(9.13) 


The matched z-transform uses this mapping to convert each numerator and denominator term of a factored 
H(s ) to yield the digital filter H(z), also in factored form, as 


M 


M 


H(s ) = C- 


II(- Zi ^> 

i =1 _ 

N 

n ( s ~ 


II (z~e^) 

H(z) = (Kz p )- <=1 


N 


(9.14) 


H(z-e^) 


fe=l 


fc=i 


The power P of z p in H(z) is P = N — M, the difference in the degree of the denominator and numerator 
polynomials of H(s). The constant K is chosen to match the gains of H(s ) and H(z ) at some convenient 
frequency (typically, dc). 

For complex roots, we can replace each conjugate pair using the mapping 


(s + p- jq)(s + p + jq) 


z 2 - 2ze~ pta cos (qt s ) + e~ 2pta 
^2 


(9.15) 


Since poles in the left half of the s-plane are mapped inside the unit circle in the z-plane, the matched z- 
transform preserves stability. It converts an all-pole analog system to an all-pole digital system but may not 
preserve the frequency response of the analog system. As with the impulse-invariant mapping, the matched 
z-transform also suffers from aliasing errors. 


REVIEW PANEL 9.6 

The Matched z- Transform Requires H(s ) in Factored Form 

g _ g Pk^s 

(s + Pk) =>• - (for each factor of H(s ) in factored form) 

z 

The matched z-transform is not suitable for highpass or bandpass filter design. 


9.4.1 Modifications to Matched z-Transform Design 

The matched z-transform maps the zeros of H(s) at s = oo (corresponding to the highest analog frequency 
/ = oo) to z = 0. This yields the term z p in the design relation. In the modified matched z-transform, some 
or all of these zeros are mapped to z = —1 (corresponding to the highest digital frequency F = 0.5 or the 
analog frequency / = OAS). Two modifications to H(z) are in common use: 

1. Move all zeros from z = 0 to z = —1 (or replace z p by (z + l) p ) in H(z). 

2. Move all but one of the zeros at z = 0 to z = —1 (or replace z p by z(z + l )^ 1 in H(z)). 

These modifications allow us to use the matched z-transform even for highpass and bandstop filters. 

| REVIEW PANEL 9d7] 

Two Modifications to Matched z-Transform Design 

1 . Move all zeros from z = 0 to z = —1. 2. Move all but one of the zeros at z = 0 to z = —1. 
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EXAMPLE 9.4 (The Matched z- Transform) 

4 

Convert H(s) = - -—-- to H(z ) by the matched 2 -transform and its modifications, with t s = 0.5 s. 


(s + 1 ) (s + 2 ) 

(a) No modification: The matched 2 -transform yields 

Kz 2 Kz 2 

H(z) = 


Kz 2 


(2 — e~ ts )(z — e~ 2ts ) (2 — e~°- 5 )(z — e -1 ) 2 2 - 0.97442 + 0.2231 


(b) First modification: Replace both zeros in H(z) (the term z 2 ) by (2 + l) 2 : 

A 1 (2+l ) 2 Ai(2 + 1) 2 K \(2 T l ) 2 


Hi(z) = 


(2 — e ts )(z — e 2ts ) (2 — e °- 5 )(2 —e z 2 — 0.97442 + 0.2231 


(c) Second modification: Replace only one zero in H(z) (the term z 2 ) by 2 + 1: 

K 2 z(z + 1 ) _ K 2 z(z + 1 ) _ K 2 z(z + 1 ) 


H 2 { z ) = 


(2 — e ts )(z — e 2t ») (2 — e °- 5 )(z — e 1 ) z 2 — 0.97442 + 0.2231 

Comment: The constants K, Ki, and I\ 2 may be chosen for a desired gain. 


9.5 Mappings from Discrete Algorithms 

Discrete-time algorithms are often used to develop mappings to convert analog filters to digital filters. In 
the discrete domain, the operations of integration and differentiation are replaced by numerical integration 
and numerical differences, respectively. The mappings are derived by equating the transfer function H(s) of 
the ideal analog operation with the transfer function H(z) of the corresponding discrete operation. 

9.5.1 Mappings from Difference Algorithms 

Numerical differences are often used to convert differential equations to difference equations. Three such 
difference algorithms are listed in Table 9.2. 


Table 9.2 Numerical Difference Algorithms 


Difference 

Numerical Algorithm 

Mapping for s 

Backward 

r , x[n] — x\n — ll 

y[n] = , 

ts 

2-1 

s =- 

Zt s 

Forward 

x[n + 1] — x\n] 

y[n \ = 

ts 

2-1 
s = - 

t s 

Central 

x[n+l]-x[n-l] 

_ 2 2 - 1 

V[ J 2 t a 

2 zt s 
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Backward Euler algorithm 



Forward Euler algorithm 


Figure 9.3 Backward-difference and forward-difference algorithms 


Numerical differences approximate the slope (derivative) at a point, as illustrated for the backward- 
difference and forward-difference algorithms in Figure 9.3. 

The mappings that result from the operations (also listed in Table 9.2) are based on comparing the ideal 
derivative operator H(s) = s with the transfer function H(z) of each difference algorithm, as follows: 


Backward difference: y[n] = 


x[n] — x[n — 1] 


= x ( ,) -pM H{z)= m izi 

ts A (z) zt s 


s = 


z- 1 

zts 


(9.16) 


Forward difference: y[n ] = 


x[n + 1] — x[n\ 

ts 


Y(z) = zX{z) - X(z) H(z) = Y(z) _z- 1 


Central difference: y[n] = 


t s X{z) t s 

x[n + 1] — x[n — 1] 

2 Ts 


zX(z)-z 1 X(z) Y(z) z 2 — 1 

( ) ~ - 2 T, - H{z) X(Z ) 1^7 


Z-l 


s = 


z 2 -l 
2 zts 


(9.17) 


(9.18) 


9.5.2 Stability Properties of the Backward-Difference Algorithm 

The backward-difference mapping s —> {z — \)/zt s results in 

1 A st s 1 T st s 

z = 0.5 + 0.5--- a:- 0.5 = 0.5--- (9.19) 

1 - St s 1 -St s 

To find where the jw-axis maps, we set a = 0 to obtain 

2 - 0.5 = 0.5^-M^ h-0.51 =0.5 (9.20) 

1 -juts 11 V ; 

Thus, the jw-axis is mapped into a circle of radius 0.5, centered at z = 0.5, as shown in Figure 9.4. 

Since this region is within the unit circle, the mapping preserves stability. It does, however, restrict the 
pole locations of the digital filter. Since the frequencies are mapped into a smaller circle, this mapping is a 
good approximation only in the vicinity of 2 = 1 or O ss 0 (where it approximates the unit circle), which 
implies high sampling rates. 
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s-plane 



The backward-difference mapping 


The left half of the s-plane 
is mapped to the interior of a circle 
of radius 0.5 and centered at z = 0.5 



Figure 9.4 Mapping region for the mapping based on the backward difference 


9.5.3 The Forward-Difference Algorithm 

The mapping for the forward-difference is s —■» (z — 1) /t s . With z = u + jv, we obtain 

z = u + jv = 1 + t s (a + ju>) (9-21) 

If a = 0, then u = 1, and the jw-axis maps to z = 1. If a > 0, then u > 1, and the right half of the s-plane 
maps to the right of z = 1. If tr < 0, then u < 1, and the left half of the s-plane maps to the left of z = 1, 
as shown in Figure 9.5. This region (in the 2 -plane) includes not only the unit circle but also a vast region 
outside it. Thus, a stable analog filter with poles in the left half of the s-plane may result in an unstable 
digital filter H(z) with poles anywhere to the left of z = 1 (but not inside the unit circle) in the 2 -plane ! 



The forward-difference mapping 

The left half of the s-plane 
is mapped to a region to the left of z = 1 



Figure 9.5 Mapping region for the mapping based on the forward difference 


REVIEW PANEL 9.8 


Mappings Based on the Backward Difference and Forward Difference 

z — 1 z — 1 

Backward difference: s = - (stable) Forward difference: s = - (not always stable) 

Zt- S t s 


EXAMPLE 9.5 (Mappings from Difference Algorithms) 

(a) We convert the stable analog filter H(s ) = —-—, a > 0, to a digital filter, using the backward- 

s + a 

difference mapping s = (z — 1 )/zt s to obtain 


H{z) 


1 

a + (z — 1 )/zt s 


zt s 

(1 + at s )z — 1 
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The digital filter has a pole at 2 = 1/(1 + at s ). Since this is always less than unity if a > 0 (for a 
stable H(s )) and t s > 0, we have a stable H{z). 


(b) We convert the stable analog filter H(s ) = -, a > 0, to a digital filter, using the forward-difference 

s + a 

mapping s = (z — 1 )/t s to obtain 


a + (z - l)/t s z-(l-at s ) 

The digital filter has a pole at 2 = 1 — at s and is thus stable only if 0 < at s < 2 (to ensure \z\ < 1). 
Since a > 0 and t s > 0, we are assured a stable system only if a < 2 /t s . This implies that the sampling 
rate S must be chosen to ensure that S > 0.5a. 


(c) We convert the stable analog filter H(s ) 
mapping s = (z 2 — l)/2zt s to obtain 


-, a > 0 , to a digital filter, using the central-difference 

s + a 


H(z) 


1 

a + ( 2 2 — l)/2 zt 3 


2 zt s 

z 2 + 2 ort s z — 1 


The digital filter has a pair of poles at 2 = —at s ± y/(at s ) 2 + 1. The magnitude of one of the poles is 
always greater than unity, and the digital filter is thus unstable for any a > 0 . 


Comment: Clearly, from a stability viewpoint, only the mapping based on the backward difference is useful 
for the filter H(s) = l/(s + a). In fact, this mapping preserves stability for any stable analog filter. 


9.5.4 Mappings from Integration Algorithms 

Two commonly used algorithms for numerical integration are based on the rectangular rule and trapezoidal 
rule. These integration algorithms, listed in Table 9.3, estimate the “area” y[n] from y[n — 1] by using step 
interpolation (for the rectangular rule) or linear interpolation (for the trapezoidal rule) between the samples 
of x[n], as illustrated in Figure 9.6. 


Table 9.3 Numerical Integration Algorithms 


Rule 

Numerical Algorithm 

Mapping for 

' s 

Rectangular 

y[n] = y[n - 1 ] + t s x[n] 

s = £l 


\ 

Trapezoidal 

y[n] = y[n — 1] + 0.5< s ( x[n ] + x[n — 1]) 

s = l\ 

(£) 

\ 


The mappings resulting from these operators are also listed in Table 9.3 and are based on comparing 
the transfer function H{s) = 1/s of the ideal integrator with the transfer function H(z) of each integration 
algorithm, as follows: 
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y[n] = y\n —\] + f s x[»] y[n] = y[n-\] + 0.5f s {v [n]+x [n-l]} 




Rectangular rule Trapezoidal rule 

Figure 9.6 Illustrating numerical integration algorithms 


Rectangular rule: y[n] = y[n — 1] + t s x[n] 


Y(z) = z 1 Y(z) + t s X(z) H(z) = 


Y ( z ) zt s 


X(z) z-1 


z-1 

Zt s 


(9.22) 


We remark that the rectangular algorithm for integration and the backward difference for the derivative 
generate identical mappings. 


Trapezoidal rule: y[n] = y[n — 1] + 0.5t s (a;[n] + x[n — 1]) 

Y(z) = z~ 1 Y(z) + 0.5 t s [X(z) + z^X(z) H{z) = ^ 

A (z) z — 1 

The mapping based on the trapezoidal rule is also called Tustin’s rule. 


2 

s = — 

ts 


z-1 

z + 1 


(9.23) 


9.5.5 Stability Properties of Integration-Algorithm Mappings 

Mappings based on the rectangular and trapezoidal algorithms always yield a stable H(z) for any stable 
it(s), and any choice of t s . The rectangular rule is equivalent to the backward-difference algorithm. It thus 
maps the left half of the s-plane to the interior of a circle of radius 0.5 in the 2 -plane, centered at 2 = 0.5, 
and is always stable. For the trapezoidal rule, we express 2 in terms of s = a + ju> to get 

_ 2 + st s _ 2 + at s + jujt s ,g 24) 

2 — st s 2 — at s — jujt s 

If a = 0, we get 1 2 1 = 1, and for cr < 0, \z\ < 1 . Thus, the j cu-axis is mapped to the unit circle, and the left 
half of the s-plane is mapped into the interior of the unit circle, as shown in Figure 9.7. This means that a 
stable analog system will always yield a stable digital system using this transformation. If ui = 0, we have 
2 = 1 , and the dc gain of both the analog and digital filters is identical. 

Discrete difference and integration algorithms are good approximations only for small digital frequencies 
(.F < 0.1, say) or high sampling rates S (small t s ) that may be well in excess of the Nyquist rate. This is 
why the sampling rate is a critical factor in the frequency-domain performance of these algorithms. Another 
factor is stability. For example, the mapping based on the central-difference algorithm is not very useful 
because it always produces an unstable digital filter. Algorithms based on trapezoidal integration and the 
backward difference are popular because they always produce stable digital filters. 
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Figure 9.7 Mapping region for the trapezoidal integration algorithm 



EXAMPLE 9.6 (Mappings from Integration Algorithms) 

(a) Convert H(s) = -, a > 0, to a digital filter H(z), using the trapezoidal numerical integration 

s + a 

algorithm, and comment on the stability of H{z). 

Using the the mapping based on the trapezoidal rule, we obtain 


H(z) = H(s) 


S — 


2 (*~ 1 ) 
ts(z + 1) 


t s (z + 1 ) 

(2 + at s )z — (2 — at s ) 


The pole location of H (z) is z = (2 — at s )/ (2 + at s ). Since this is always less than unity (if a > 0 and 
t s > 0 ), we have a stable H(z). 


(b) Simpson’s algorithm for numerical integration finds y[n] over two time steps from y[n — 2] and is given 

by 

■y[n] = y[n — 2] + y (x[n] + 4 x[n — 1] + x[n — 2]) 

Derive a mapping based on Simpson’s rule, use it to convert H(s) = -, a > 0, to a digital filter 

S H - OL 

H(z ), and comment on the stability of H(z). 

The transfer function Hs{z) of this algorithm is found as follows: 


Y(z) = z~ 2 Y(z) + |(1 + 4z -i + z~ z )X{z) 


Hs{z) = t s 


z 2 + 4z + 1 
3(z 2 - 1) 


Comparison with the transfer function of the ideal integrator H(s) = 1/s gives 


3 r z 2 - 1 

t s z 2 T 4z T 1 
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If we convert H(s) = l/(s + a), using this mapping, we obtain 


H(z) 


t s ( z 2 + Az + 1) 

(3 + at s )z 2 + Aat s z — (3 — at s ) 


The poles of H{z) are the roots of (3 + at s )z 2 + Aat s z — (3 — at s ) = 0. The magnitude of one of these 
roots is always greater than unity (if a > 0 and t s >0), and H{z) is thus an unstable filter. 


9.5.6 Frequency Response of Discrete Algorithms 

The frequency response of an ideal integrator is Hj(F) = A/j2'nF. For an ideal differentiator, H f >(F) = 
j2irF. In the discrete domain, the operations of integration and differentiation are replaced by numerical 
integration and numerical differences. Table 9.4 lists some of the algorithms and their frequency response 
H(F). 


Table 9.4 Discrete Algorithms and their Frequency Response 


Algorithm 

Difference Equation 

Frequency Response 

Numerical Differences 

Backward 

y[n] = x[n\ — x[n — 1] 

H b {F) = 1 - e~^ F 

Central 

y[n] = \{x[n + 1] — x[n - 1]) 

H c (F)=jsm(2nF) 

Forward 

y[n] = x[n + 1] — x[n] 

H f (F) = e^ F - 1 

Numerical Integration 

Rectangular 

y [n — 1] + x [n] 

h r {f) l _ e _ j2nF 

Trapezoidal 

y[n - 1] + \{x[n] + x[n - 1]) 

1 + e -i 27rF 

^> = 2(1 -e~^n 

Simpson’s 

y[n — 2] + \{x[n\ + Ax[n — 1] + x[n — 2]) 

Hs(F) _ 1 + ^ 
S{ ’ 3(1 - e~i^ F ) 


Numerical differences approximate the slope (derivative) at a point and numerical integration algorithms 
estimate the area y[n] from y[n — 1] by using step, linear, or quadratic interpolation. Only Simpson’s rule 
finds y[n] over two time steps from y[n — 2]. Discrete algorithms are good approximations only at low digital 
frequencies (F < 0.1, say). Even when we satisfy the sampling theorem, low digital frequencies mean high 
sampling rates, well in excess of the Nyquist rate. This is why the sampling rate is a critical factor in the 
frequency-domain performance of these operators. Another factor is stability. For example, if Simpson’s 
rule is used to convert analog systems to discrete systems, it results in an unstable system. The trapezoidal 
integration algorithm and the backward difference are two popular choices. 
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EXAMPLE 9.7 (DTFT of Numerical Algorithms) 

(a) For the trapezoidal numerical integration operator, the DTFT yields 


Y P (F) = Y p {F)e~^ F + 0.5 [X P (F) + e~^ F X P {F)} 


A simple rearrangement leads to 


H t (F) 


Y P (F) 

X P (F) 


1 T e~F irF "| 
1 - e-F* 


1 

j2tan(7rF) 


Normalizing this by Hj(F) = l/j2irF and expanding the result, we obtain 

H T (F) _ j2irF _ 7 tF (t tF) 2 (t tF) 4 

Hj(F) j2tan(nF ) tan(7rE) 3 45 


Figure E9.7 shows the magnitude and phase error by plotting the ratio Ht{F)/H j(F). For an 
ideal algorithm, this ratio should equal unity at all frequencies. At low frequencies (F <C 1), we 
have tan(7rF) ss 7 tF, and Ht(F)/H j(F) « 1, and the trapezoidal rule is a valid approximation to 
integration. The phase response matches the ideal phase at all frequencies. 


(a) Magnitude spectrum of integration algorithms 


(c) Magnitude spectrum of difference algorithms 




(b) Phase spectrum of integration algorithms (d) Phase spectrum of difference algorithms 




0 0.05 0.1 0.15 0.2 0 0.05 0.1 0.15 0.2 

Digital frequency F Digital frequency F 

Figure E9.T Frequency response of the numerical algorithms for Example 9.7 


(b) Simpson’s numerical integration algorithm yields the following normalized result: 

/2 + cos^ 
iT/(F) v 3 sin 2nF ) 

It displays a perfect phase match for all frequencies, but has an overshoot in its magnitude response 
past F = 0.25 and thus amplifies high frequencies. Note that Simpson’s algorithm yields a mapping 
rule that results in an unstable filter. 
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(c) For the forward difference operator, the DTFT yields 

Y P (F) = X p (F)e^ F - X p (F) = X p (F)[e^ F - 1] H f (F) = = e^ F - 1 


The ratio H f (F)/Hd(F) may be expanded as 


H f (F) 

Hd(F) 


l+ji(27rF)-^(2 7 rF 1 ) 2 + ... 


Again, we observe correspondence only at low digital frequencies (or high sampling rates). The high 
frequencies are amplified, making the algorithm susceptible to high-frequency noise. The phase response 
also deviates from the true phase, especially at high frequencies. 


(d) For the central difference algorithm, we find Hc(F)/H jj(F) as 


HcjF] 

H d {F) 


sin(2.F) 1 1 

2t tF 3P ' 5P ; 


We see a perfect match only for the phase at all frequencies. 


9.5.7 Mappings from Rational Approximations 

Some of the mappings that we have derived from numerical algorithms may also be viewed as rational 
approximations of the transformations z —» e sts and s —> In (z)/t s . The forward-difference mapping is based 
on a first-order approximation for z = e sts and yields 

z — 1 

z = e st “ « 1 + st s , st s <C 1 s «- (9.25) 

ts 

The backward-difference mapping is based on a first-order approximation for z~ x = e~ sta and yields 

1 z — 1 

- = e~ sts « 1 — st s , st s <C 1 s ss- (9.26) 

z zt a 


The trapezoidal mapping is based on a first-order rational function approximation of s = In {z)/t s , with ln(z) 
described by a power series, and yields 


ln(z) 2 

'z-1 

2 

+ —- 

'z-1 

2 2 
+ —- 

'z-1' 

t S t s 

.Z + 1. 

3 t s 

.Z + 1. 

5 t a 

.z + 1. 


(9.27) 


9.6 The Bilinear Transformation 


If we generalize the mapping based on the trapezoidal rule by letting C 

transformation, defined by 


s = C 


z-1 
z + 1 


z = 


C + s 
C-s 


2/t a , we obtain the bilinear 
(9.28) 
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If we let a = 0, we obtain the complex variable 2 in the form 

* = C+jU = e J2 tan-bo ,/C) (9.29) 

C-ju 

Since z = where f l = 2 ttF is the digital frequency, we find 

= 2taiV 1 (w/C) u> = C'tan(0.5fl) (9.30) 

This is a nonlinear relation between the analog frequency oj and the digital frequency O. When u> = 0, fl = 0, 
and as cu —> oo, —> tt. It is thus a one-to-one mapping that nonlinearly compresses the analog frequency 
range —oo < / < oo to the digital frequency range — 7r < fl < n. It avoids the effects of aliasing at the 
expense of distorting, compressing, or warping the analog frequencies, as shown in Figure 9.8. 

The higher the frequency, the more severe is the warping. We can compensate for this warping (but 
not eliminate it) if we prewarp the frequency specifications before designing the analog system H(s) or 
applying the bilinear transformation. Prewarping of the frequencies prior to analog design is just a scaling 
(stretching) operation based on the inverse of the warping relation, and is given by 

w = Ctan(0.5n) (9.31) 

Figure 9.9 shows a plot of w versus f l for various values of C, compared with the linear relation oj = fh 
The analog and digital frequencies always show a match at the origin (w = fl = 0), and at one other value 
dictated by the choice of C. 

We point out that the nonlinear stretching effect of the prewarping often results in a filter of lower order, 
especially if the sampling frequency is not high enough. For high sampling rates, it turns out that the 
prewarping has little effect and may even be redundant. 


Equal-width intervals 



Figure 9.8 The warping effect of the bilinear transformation 


The popularity of the bilinear transformation stems from its simple, stable, one-to-one mapping. It avoids 
problems caused by aliasing and can thus be used even for highpass and bandstop filters. Though it does 
suffer from warping effects, it can also compensate for these effects, using a simple relation. 


REVIEW PANEL 9.10 


The Bilinear Transformation Avoids Aliasing at the Expense of Nonlinear Warping 

z — 1 

—- Warping relation: u> = Ctan(0.5fl) 


Bilinear transformation: s — C 
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Figure 9.9 The warping relation u> = C tan(0.5fi) for various choices of C 


9.6.1 Using the Bilinear Transformation 

Given an analog transfer function H(s) whose response at the analog frequency u>a is to be matched to H{z) 
at the digital frequency fin, we may design H(z) in one of two ways: 


1. We pick C by matching uja and the prewarped frequency fl n , and obtain H(z) from if(s), using the 
z — 1 

transformation s = C —— r . This process may be summarized as follows: 


z + 1 

uja = Ctan(0.5fi£>) 


C = 


u A 


tan(0.5Hc) 


H(z) ^( S )| s= c( z -l)/(z+l) 


(9.32) 


2. We pick a convenient value for C (say, C = 1). This actually matches the response at an arbitrary 
prewarped frequency u> x given by 

u x = tan(0.5fij}) (9.33) 

Next, we frequency scale H(s) to Hi(s) = H(suja/uj x ), and obtain H(z ) from Hi(s), using the trans- 
z — 1 

formation s = ——7 (with C = 1). This process may be summarized as follows (for (7=1): 


z + 1 
lo x = tan(0.5fi£>) 


Hi(s) = H(s)\ 3=auA/u * H(z) = Hl (s) | s=(2 _ 1)/(z+1) 


(9.34) 


The two methods yield an identical digital filter H(z). The first method does away with the scaling of H(s), 
and the second method allows a convenient choice for C. 


| REVIEW PANEL 9.11 | 

The Bilinear Transformation Allows Gain Matching by Appropriate Choice of C 

Choose C = - ,^ A — — r to match the gain of H(s) at uj a to the gain of H(z ) at fin- 

tan(0.5si£)) 


EXAMPLE 9.8 (Using the Bilinear Transformation) 

3 

(a) Consider a Bessel filter described by H(s) = 


Design a digital filter whose magnitude at 


s 2 + 3s + 3 

/o = 3 kHz equals the magnitude of H(s) at u> A = 4 rad/s if the sampling rate S = 12 kHz. 
The digital frequency is Q = 2irfo/S = 0 . 57 T. We can now proceed in one of two ways: 
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1 . Method 1 : We select C by choosing the prewarped frequency to equal u>a = 4: 

^ = 4 = Cta»(0.5«) or C = = 4 

z—l 4(2 — 1) 

We transform H(s ) to H(z), using s = C -- = --—, to obtain 

w w z+1 z + 1 

H{z) = H(s )| s=4(z _ 1)/(2+1) = 3U2 _ 26 z + 7 

2. Method 2: We choose (7=1, say, and evaluate ui x = tan(0.5fi) = tan(0.257r) = 1. 
Next, we frequency scale H(s ) to 


Hi(s) = H(su> a /u x ) = H(4s) = 


16s 2 + 12s+ 3 


Finally, we transform Hi(s) to H(z), using s = --, to obtain 

z + 1 

H(z) = H(s) | s=(z _ 1)/(2+1) = 3U 2 _ 26 z + 7 

The magnitude |iJ(s)| at s = ju = j 4 matches the magnitude of \H(z)\ at z = e jf2 = e J7r / 2 = j. 
We find that 


\H(s)\ s=j4 = 


-13 + jl2 


= 0.1696 | H(z)\ z =j = 


3 (j + 1) 2 

-24 - j26 


= 0.1696 


Figure E9.8(a) compares the magnitude of H(s) and H(z). The linear phase of the Bessel filter is not 
preserved during the transformation (unless the sampling frequency is very high). 


(a) Bessel filter H(s ) and digital filter H(z) (b) Notch filter H(s) and digital filter H(z) 



0 12 3 4 5 6 0 20 40 60 80 100 120 


Analog frequency / [kHz] Analog frequency / [Hz] 

Figure E9.8 Magnitude of the analog and digital filters for Example 9.8(a and b) 


s + 1 

(b) The twin-T notch filter H(s ) = ,,-has a notch frequency u>q = 1 rad/s. Design a digital notch 

s + 4s + 1 

filter with S = 240 Hz and a notch frequency / = 60 Hz. 

The digital notch frequency is O = 2nf /S = 0.57T. We pick C by matching the analog notch frequency 
u >o and the prewarped digital notch frequency O to get 

lvo = Ctan(0.5H) 1 = Ctan(0.257r) (7=1 
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Finally, we convert H(s) to H{z ), using s = C 


z-1 


z + 1 


z-1 
z + 1 


to get 


H(z) 


H(s) 


s=(z-l)/(z+l) 


(z-l) 2 + (z + l) 2 
(z - l ) 2 + 4(z 2 — 1) + (z + l ) 2 


z 2 +1 
3 z 2 - 1 


We confirm that H(s) = 0 at s = jui o = j and H(z) =0 at z = e= e^! 2 = j. Figure E9.8(b) shows 
the magnitude of the two filters and the perfect match at / = 60 Hz (or F = 0.25). 


9.7 Spectral Transformations for HR Filters 

The design of HR filters usually starts with an analog lowpass prototype, which is converted to a digital 
lowpass prototype by an appropriate mapping and transformed to the required filter type by an appropriate 
spectral transformation. For the bilinear mapping, we may even perform the mapping and the spectral 
transformation (in a single step) on the analog prototype itself. 

9.7.1 Digital-to-Digital Transformations 

If a digital lowpass prototype has been designed, the digital-to-digital (D2D) transformations of Table 9.5 
can be used to convert it to the required filter type. These transformations preserve stability by mapping 
the unit circle (and all points within it) into itself. 

As with analog transformations, the lowpass-to-bandpass (LP2BP) and lowpass-to-bandstop (LP2BS) 
transformations yield a digital filter with twice the order of the lowpass prototype. The lowpass-to-lowpass 
(LP2LP) transformation is actually a special case of the more general allpass transformation: 

z — QL 

z => ±-, led < 1 (and a real) (9.35) 

1 — az 


EXAMPLE 9.9 (Using D2D Transformations) 

3(z + l ) 2 

A lowpass filter H(z) = -„- operates at S = 8 kHz, and its cutoff frequency is fc = 2 kHz. 

31z 2 — 26z + 7 

(a) Use H(z) to design a highpass filter with a cutoff frequency of 1 kHz. 

We find Qn = 2 tt fc/S = 0 . 57 T and Qc = 0.25-7T. The LP2HP transformation (Table 9.5) requires 


a = — 


= -0.4142 


The LP2HP spectral transformation is thus z 

Hylp(z) = 


cos[0.5(12/) + He)] cos(37t/8) 

cos[0.5(H/3 — He)] cos( 7 r/ 8 ) 

-(z + a) -(z- 0.4142) 


1 + az 
0.28(z — l ) 2 


1 - 0.4142z 


and yields 


z 2 - 0.0476z + 0.0723 


(b) Use H(z) to design a bandpass filter with band edges of 1 kHz and 3 kHz. 

The various digital frequencies are Hi = 0.257T, H 2 = 0 . 757 T, H 2 — fij = 0 . 57 T, and H 2 + Hi = 7 r. 


©Ashok Ambardar, September 1, 2003 




9.7 Spectral Transformations for HR Filters 


387 


Table 9.5 Digital-to-Digital (D2D) Frequency Transformations 


Note: The digital lowpass prototype cutoff frequency is fin- 
All digital frequencies are normalized to fi = 2irf/S. 

Form 

Band Edge(s) 

Mapping z —> 

Mapping Parameters 

LP2LP 

flc 

z — a 

1 — az 

a = sin[0.5(f2j3 — ST<s')]/ s i n [0.5(SA + fie)] 

LP2HP 

flc 

— (z + a) 

1 + az 

a = — cos[0. 5(£Id + Uc)]/cos[0.5(Ud — fic)] 

LP2BP 

[Oi, n 2 ] 

— (z 2 + A\z + A 2 ) 
A 2 z 2 + A\z + 1 

K = tan(0.5f2£))/tan[0.5(f2 2 — fii)] 

a = — cos[0.5(H 2 + fli)]/cos[0.5(f2 2 — Hi)] 

A x = 2aK/(K +1) A 2 = (K - 1 )/(K + 1) 

LP2BS 

[Oi, H 2 ] 

(z 2 + A\z + A 2 ) 
A 2 Z ^ -|- A\Z H- 1 

K = tan(0.5f2£))tan[0.5(f22 — fli)] 

a = — cos[0.5(H 2 + fli)]/cos[0.5(f2 2 — ^ 1 )] 

A 1 =2a/{K+\) A 2 = -(K-1)/(K+1) 


From Table 9.5, the parameters needed for the LP2BP transformation are 

“ sW2) =0 Ai =0 


K = tan(7r/4) = 1 


tan(7r/4) cos(7t/4) 

The LP2BP transformation is thus 2 —» — z 2 and yields 


A 2 = 0 


Hbp(z) 


3(z 2 — l) 2 
3U 4 + 26z 2 + 7 


(c) Use H{z) to design a bandstop filter with band edges of 1.5 kHz and 2.5 kHz. 
Once again, we need = 37r/8, Vl 2 = 57r/8, fl 2 — Hi = 7r/4, and Q 2 + Hi = n. 
From Table 9.5, the LP2BS transformation requires the parameters 

cos(7t/2) 


K = = 0.4142 

tan(7r/4) 

The LP2BS transformation is thus z 


cos(7r/8) 

2 2 + 0.4142 
O.41420 2 + 1 


= 0 


A, = 0 


and yields 


Hbs{z) = 


0.28(z 2 + l) 2 


A 2 = 0.4142 


2 4 + 0.0476U 2 + 0.0723 
Figure E9.9 compares the magnitudes of each filter designed in this example. 
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1 

0.8 
<D 

1 0 - 6 
'2 
&Q 

I °- 4 

0.2 

0 

0 0.5 1 1.5 2 2.5 3 3.5 4 

Analog frequency / [kHz] 

Figure E9.9 The digital filters for Example 9.9 



9.7.2 Direct (A2D) Transformations for Bilinear Design 

All stable transformations that are also free of aliasing introduce warping effects. Only the bilinear mapping 
offers a simple relation to compensate for the warping. Combining the bilinear mapping with the D2D 
transformations yields the analog-to-digital (A2D) transformations of Table 9.6 for bilinear design. These 
can be used to convert a prewarped analog lowpass prototype (with a cutoff frequency of 1 rad/s) directly 
to the required digital filter. 


Table 9.6 Direct Analog-to-Digital (A2D) Transformations for Bilinear Design 


Note: The analog lowpass prototype prewarped cutoff frequency is 1 rad/s. 

The digital frequencies are normalized (H = 2iif/S) but are not prewarped. 

Form 

Band Edge(s) 

Mapping s —> 

Mapping Parameters 

LP2LP 

He 

2-1 

(7 = tan(0.5fie) 

(7(2 + 1) 

LP2HP 

He 

(7(2 + 1) 

(7 = tan(0.5fie) 

2-1 

LP2BP 


2 2 -2/32 + 1 

(7 = tan[0.5(H 2 — Hi)], (3 = cosHq or 

/3 = cos[0.5(H 2 + H 1 )]/cos[ 0.5(H 2 — Hi)] 

<7(2 2 - 1) 

LP2BS 

^ ^2 

C(z 2 - 1) 

(7 = tan[0.5(H 2 — Hi)], (3 = cosHq or 

f3 = cos[0.5(H 2 + Hi)]/cos[ 0.5(H 2 — Hi)] 

2 2 — 2/3z + 1 


9.7.3 Bilinear Transformation for Peaking and Notch Filters 

If we wish to use the bilinear transformation to design a second-order digital peaking (bandpass) filter 
with a 3-dB bandwidth of Afi and a center frequency of Hq, we start with the lowpass analog prototype 
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H(s) = l/(s + 1) (whose cutoff frequency is 1 rad/s), and apply the A2D LP2BP transformation, to obtain 

C ( + _ i \ 

Hbp(z) = + —- ~ 2 p - yzc ) @ = cos^o C = tan(0.5AO) (9.36) 

+ V* -T+C z+ T+cJ 

Similarly, if we wish to use the bilinear transformation to design a second-order digital notch (bandstop) 
filter with a 3-dB notch bandwidth of AO and a notch frequency of Oo, we once again start with the lowpass 
analog prototype H(s ) = l/(s + 1), and apply the A2D LP2BS transformation, to obtain 

1 ( A — 2 Qz + 1 \ 

Hbs{z) = — — 2 p - YZc ) P = cosOo C = tan(0.5AO) (9.37) 

+ \ z ~ ~ T+C z + T+C / 

If either design calls for an A-dB bandwidth of AO, the constant C is replaced by KC, where 

XOD-iA^x ) in dB ) ( 9 - 38 ) 

This is equivalent to denormailzing the lowpass prototype such that its gain corresponds to an attenuation 
of A decibels at unit radian frequency. For a 3-dB bandwidth, we obtain I\ = 1 as expected. These design 
relations prove quite helpful in the quick design of notch and peaking filters. 

The center frequency Oo is used to determine the parameter (3 = cosOo- If only the band edges Oi 
and O 2 are specified, but the center frequency Oo is not, (3 may also be found from the alternative relation 
of Table 9.6 in terms of Oi and O 2 . The center frequency of the designed filter will then be based on the 
geometric symmetry of the prewarped frequencies and can be computed from 

tan(0.5O 0 ) = \/tan(0.50i)tan(0.502) (9.39) 



In fact, the digital band edges Oi and O 2 do not show geometric symmetry with respect to the center 
frequency Oo- We can find Oi and O 2 in terms of AO and Oo by equating the two expressions for finding /3 
(in Table 9.6) to obtain 


j3 = cos O 0 


cos[ 0.5(O 2 + Oi)] 
cos[ 0.5(O 2 — Oi)] 


(9.40) 


With AO = O 2 — Oi, we get 


0 2 = 0.5AO + cos 1 [cos O 0 cos(0.5AO)] 


Ox = 0 2 — AO 


(9.41) 


EXAMPLE 9.10 (Bilinear Design of Second-Order Filters) 

(a) Let us design a peaking filter with a 3-dB bandwidth of 5 kHz and a center frequency of 6 kHz. The 
sampling frequency is 25 kHz. 


The digital frequencies are AO = 27 t( 5/25) = 0.4-7T and O 0 = 27 t(6/25) = 0.48-7T. 

We compute C = tan(0.5AO) = 0.7265 and (3 = cosO 0 = 0.0628. Substituting these into the form for 
the required filter, we obtain 


H(z) 


0.4208(z 2 - 1) 

2 2 - 0.0727^ + 0.1584 


Figure E9.10(a) shows the magnitude spectrum. The center frequency is 6 kHz, as expected. The band 
edges Oi and 0 2 may be computed from 


0 2 = 0.5AO + cos -1 [cos O 0 cos(0.5AO)] = 2.1483 O x = 0 2 - AO = 0.8917 
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These correspond to the frequencies /i = 4^ = 3.55 kHz and / 2 = 4^ = 8.55 kHz. 




0 3.55 6 8.55 12.5 0 4 6.56 9 12.5 

Analog frequency / [kHz] Analog frequency / [kHz] 

Figure E9.10 Response of bandpass filters for Example 9.10 (a and b) 


(b) Let us design a peaking (bandpass) filter with a 3-dB band edges of 4 kHz and 9 kHz. The sampling 
frequency is 25 kHz. 

The digital frequencies are Hi = 27 t( 4/25) = 0.327T, fi 2 = 27 t( 6/25) = 0.727T, and AH = 0.47T. 

We find C = tan(0.5Afi) = 0.7265 and 8 = cos[0.5(fi 2 +Hi)]/cos[0.5(fi 2 —Hi)] = —0.0776. Substituting 
these into the form for the required filter, we obtain 


H(z) 


0.4208 {z 2 - 1) 
z 2 + 0.0899z + 0.1584 


Figure E9.10(b) shows the magnitude spectrum. The band edges are at 4 kHz and 9 kHz as expected. 
The center frequency, however, is at 6.56 kHz. This is because the digital center frequency Ho must be 
computed from 8 = cosH 0 = —0.0776. This gives H 0 = cos -1 (—0.0776) = 1.6485. This corresponds 
to f 0 = 5H 0 /(2tt) = 6.5591 kHz. 

Comment: We could also have computed Ho from 

tan(0.5H o ) = x /tan(0.5Hi) tan(0.5H 2 ) = 1.0809 


Then, fi 0 = 2 tan 1 (1.0809) = 1.6485, as before. 


(c) We design a peaking filter with a center frequency of 40 Hz and a 6-dB bandwidth of 2 Hz, operating 
at a sampling rate of 200 Hz. 

We compute AH = 27r(2/200) = 0.02-7T and Ho = 27 t( 40/200) = 0.47T and 8 = cos Ho = 0.3090. 

Since we are given the 6-dB bandwidth, we compute K and C as follows: 


(_i_Y /2 

\10 01A — 1 ) 


1 

10°- 6 - 1 



0.577 


C = K tan(0.5AH) = 0.0182 


Substituting these into the form for the required filter, we obtain 


H(z) 


0.0179(z 2 - 1) 

2 2 - 0.6070z + 0.9642 


Figure E9.10C shows the magnitude spectrum. The blowup reveals that the 6-dB bandwidth (where 
the gain is 0.5) equals 2 Hz, as required. 
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0 20 40 60 80 100 35 39 40 41 45 

Analog frequency / [Hz] Analog frequency / [Hz] 

Figure E9.10C Response of peaking filter for Example 9.10(c) 


EXAMPLE 9.11 (Interference Rejection) 

We wish to design a filter to remove 60-Hz interference in an ECG signal sampled at 300 Hz. A 2-s recording 
of the noisy signal is shown in Figure E9.11A. 


Two beats (600 samples) of ECG signal with 60-Hz noise 



Figure E9.11A Simulated ECG signal with 60-Hz interference for Example 9.11 

If we design a high-Q notch filter with Q = 50 and a notch at fo = 60 Hz, we have a notch bandwidth of 
A/ = fo/Q = 1.2 Hz. The digital notch frequency is Hq = 2nf 0 /S = 27t( 60/300) = 0.47T, and the digital 
bandwidth is AH = 2ttA f/S = 2tt(1.2/300) = 0.008tt. 

We find C = tan(0.5Afi) = 0.0126 and (3 = cos Ho = 0.3090. Substituting these into the form for the 
notch filter, we obtain 

0.9876(2 2 - 0.61802 + 1) 
l( ^ ~ z 2 - 0.61042 + 0.9752 

A low-Q design with Q = 5 gives A/ = fo/Q = 12 Hz, and AH = 27r(12/300) = 0.087T. 

We find C = tan(0.5AH) = 0.1263 and, with /3 = cosH 0 = 0.3090 as before, we obtain 

0.8878(2 2 - 0.61802 + 1) 

2 ^ Z) ~ 2 2 - 0.54872 + 0.7757 

Figure E9.11B shows the magnitude spectrum of the two filters. Naturally, the filter Hi(z) (with the 
higher Q) exhibits the sharper notch. 
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0 30 60 90 120 150 0 30 60 90 120 150 

Analog frequency / [Hz] Analog frequency / [Hz] 

Figure E9.11B Response of the notch filters for Example 9.11 

The filtered ECG signal corresponding to these two notch filters is shown in Figure E9.11C. Although 
both filters are effective in removing the 60-Hz noise, the filter H- 2 (z) (with the lower Q) shows a much 
shorter start-up transient (because the highly oscillatory transient response of the higli-Q filter H\(z) takes 
much longer to reach steady state). 


(a) Filtered ECG signal using 60-Hz notch filter with Q = 50 




Time t [seconds] 

Figure E9.11C Output of the notch filters for Example 9.11 


9.8 Design Recipe for IIR Filters 

There are several approaches to the design of IIR filters, using the mappings and spectral transformations 
described in this chapter. The first approach, illustrated in Figure 9.10, is based on developing the analog 
filter H{s) followed by the required mapping to convert H{s) to H(z). 

A major disadvantage of this approach is that it cannot be used for mappings that suffer from aliasing 
problems (such as the impulse-invariant mapping) to design highpass or bandpass filters. 

The second, indirect approach, illustrated in Figure 9.11, tries to overcome this problem by designing 
only the lowpass prototype Hp(s) in the analog domain. This is followed by the required mapping to obtain 
a digital lowpass prototype Hp(z). The final step is the spectral (D2D) transformation of Hp(z) to the 
required digital filter H(z). 
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Lowpass 
analog prototype 
H P (s) 

Analog 

transformation 

Analog filter 
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Digital filter 

> 

H(s) 

> 

H(z) 

co c = 1 rad/s 

V 

V 


Figure 9.10 Converting an analog filter to a digital filter 


Lowpass 
analog prototype 
H P (s) 

S-^ z 
mapping 

K 

Lowpass 
digital prototype 

Hp (z) 

D2D 

transformation 

s 

Digital filter 

> 

> 

H(z) 

C 0 C = 1 rad/s 

V 

Cl c = 1 rad/s 

/ 


Figure 9.11 Indirect conversion of an analog filter to a digital filter 


This approach allows us to use any mappings, including those (such as response invariance) that may 
otherwise lead to excessive aliasing for highpass and bandstop filters. Designing Hp(z) also allows us to 
match its dc magnitude with Hp(s) for subsequent comparison. 

A third approach that applies only to the bilinear transformation is illustrated in Figure 9.12. We 
prewarp the frequencies, design an analog lowpass prototype (from prewarped specifications), and apply 
A2D transformations to obtain the required digital filter H(z). 


Lowpass 
analog prototype 
Hp(s) 

C0 C = 1 rad/s 


A2D 

transformation 

> 


Digital filter 
H(z) 


Figure 9.12 Conversion of analog lowpass prototype directly to a digital filter 


A Step-by-Step Approach 

Given the passband and stopband edges, the passband and stopband attenuation, and the sampling frequency 
S, a standard recipe for the design of HR filters is as follows: 

1. Normalize (divide) the design band edges by S. This allows us to use a sampling interval t s = 1 in 
subsequent design. For bilinear design, we also prewarp the normalized band edges. 

2. Use the normalized band edges and attenuation specifications to design an analog lowpass prototype 
Hp(s ) whose cutoff frequency is uq = 1 rad/s. 

3. Apply the chosen mapping (with t s = 1) to convert H P (s) to a digital lowpass prototype filter H P (z ) 
with flp> = 1. 

4. Use D2D transformations (with Op = 1) to convert Hp(z) to H(z). 

5. For bilinear design, we can also convert Hp(s) to H(z) directly (using A2D transformations). 
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REVIEW PANEL 9.12 
Design Recipe for HR Digital Filters 

Normalize (divide) band edges by S (and prewarp if using bilinear design). 

Use the normalized band edges to design analog lowpass prototype Hp(s ) with u>c = 1 rad/s. 
Apply the chosen mapping (with t s = 1) to convert Hp(s) to Hp(z) with flp> = 1. 

Use D2D transformations to convert Hp(z) to ff(z). 

For bilinear design, convert Hp(s ) to H{z) (using A2D transformations). 


EXAMPLE 9.12 (IIR Filter Design) 

Design a Chebyshev IIR filter to meet the following specifications: 

Passband edges at [1.8, 3.2] kHz, stopband edges at [1.6, 4.8] kHz, A p = 2 dB, A s = 20 dB, and sampling 
frequency S = 12 kHz. 


(a) (Indirect Bilinear Design) 

The normalized band edges [Hi, fi 2 , fi 3 , H 4 ], in increasing order, are 

[Hi, fi 2 , fi 3 , fi 4 ] = 2 tt[1.6, 1.8, 3.2, 4.8]/12 = [0.84, 0.94, 1.68, 2.51] 

The passband edges are [Hi, fi 2 ] = [0.94,1.68]. We choose C = 2 and prewarp each band-edge frequency 
using to = 2tan(0.5H) to give the prewarped values [0.89, 1.019, 2.221, 6.155]. 

The prewarped passband edges are [H pl , fi p2 ] = [1.019, 2.221]. 

We design an analog filter meeting the prewarped specifications (as described in the appendix). This 
yields the lowpass prototype and actual transfer function as 


H P (s) 

Hbp(s) 


0.1634 

s 4 + 0.7162s 3 + 1.2565s 2 + 0.5168s + 0.2058 

0.34s 4 

s 8 + 0.86s 7 + 10.87s 6 + 6.75s 5 + 39.39s 4 + 15.27s 3 + 55.69s 2 + 9.99s + 26.25 


Finally, we transform the bandpass filter Hpp(s) to H{z), using s —> 2(z — l)/(z+ 1), to obtain 


0.0026z 8 - 0.0095z 6 + 0.0142z 4 - 0.0095z 2 + 0.0026 
^ ~ z 8 - 1.94z 7 + 4.44z 6 - 5.08z 5 + 6.24z 4 - 4.47z 3 + 3.44z 2 - 1.305z + 0.59 


Figure E9.12A compares the response of the digital filter H(z) with the analog filter Hbp{s), and with 
a digital filter designed from the unwarped frequencies. 
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6 


Analog frequency / [kHz] 


Figure E9.12A Bandpass filter for Example 9.12 designed by the bilinear transformation 


(b) (Direct A2D Design) 

For bilinear design, we can also convert Hp(s) directly. 

We use the A2D LP2BP transformation with the unwarped passband edges [Qi, f2 2 ] = [0.94, 1.68]. 
The constants C and /? (from Table 9.6) are found as 


C = tan[0.5(U 2 - Ui)] = 0.3839 


= cos[0.5(ff 2 + Oi)] = 
cos[0.5(f2 2 — Qi)] 


We transform the prototype analog filter Hp(s ) to obtain 


0.0026z 8 - 0.0095x 6 + 0.0142z 4 - 0.0095z 2 + 0.0026 
^ “ 2 8 - 1.94z 7 + 4.44z 6 - 5 . 082 s + 6.24z 4 - 4.47z 3 + 3.44z 2 - 1.305z + 0.59 


This expression is identical to the transfer function H(z) of part (a). 


(c) (Design Using Other Mappings) 

We can also design the digital filter based on other mappings by using the following steps: 

1. Use the normalized (but unwarped ) band edges [0.89, 0.94, 1.68, 2.51] to design an analog lowpass 
prototype Hp(s) with luc = 1 rad/s (fortunately, the unwarped and prewarped specifications yield 
the same Hp(s) for the specifications of this problem). 

2. Convert Hp(s) to Hp(z) with Qp = 1, using the chosen mapping, with t s = 1. For the backward- 
difference, for example, we would use s = (z — 1 )/zt s = (z — 1 )/z. To use the impulse-invariant 
mapping, we would have to first convert Hp(s) to partial fraction form. 

3. Convert Hp(z) to H(z ), using the D2D LP2BP transformation with f 1p> = 1, and the unwarped 
passband edges [Q 1 , Q 2 ] = [0.94, 1.68]. 

Figure E9.12C compares the response of two such designs, using the impulse-invariant mapping and 
the backward-difference mapping (both with gain matching at dc). The design based on the backward- 
difference mapping shows a poor match to the analog filter. 
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0 1 1.61.8 3.2 4.8 6 

Analog frequency / [kHz] 

Figure E9.12C Bandpass filter for Example 9.12 designed by impulse invariance and backward difference 


9.8.1 Finite-Word-Length Effects 

The effects of quantization must be considered in the design and implementation of both HR and FIR filters. 
Quantization implies that we choose a finite number of bits and this less than ideal representation leads to 
problems collectively referred to as finite-word-length effects. 

Quantization noise: Quantization noise limits the signal-to-noise ratio. One way to improve the SNR is 
to increase the number of bits. Another is to use oversampling (as discussed earlier). 

Coefficient quantization: This refers to representation of the filter coefficients by a limited number of 
bits. Its effects can produce benign effects such as a slight change in the frequency response of the resulting 
filter (typically, a larger passbancl ripple and/or a smaller stopband attenuation) or disastrous effects (for 
HR filters) that can lead to instability. 

Roundoff errors: When lower-order bits are discarded before storing results (of a multiplication, say), 
there is roundoff error. The amount of error depends on the type of arithmetic used and the filter structure. 
The effects of roundoff errors are similar to the effects of quantization noise and lead to a reduction in the 
signal-to-noise ratio. 

Overflow errors: Overflow errors occur when the filter output or the result of arithmetic operations (such 
as the sum of two large numbers with the same sign) exceeds the permissible wordlength. Such errors are 
avoided in practice by scaling the filter coefficients and/or the input in a manner that the output remains 
within the permissible word length. 


9.8.2 Effects of Coefficient Quantization 

For HR filters, the effects of rounding or truncating the filter coefficients can range from minor changes in 
the frequency response to serious problems, including instability. Consider the stable analog filter: 


H(s) 


_ (s + 0.5)(s + 1.5) _ 

(s + l)(s + 2)(s + 4.5)(s + 8)(s + 12) 


(9.42) 


Bilinear transformation of H(s ) with t s = 0.01 s yields the digital transfer function H(z) = B(z)/A(z) whose 
denominator coefficients to double precision (A^.) and truncated to seven significant digits (A))) are given by 
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Filter Coefficients Ak 

Truncated A\. 

1.144168420199997e+0 

1.144168e+0 

-5.418904483999996e+0 

-5.418904e+0 

1.026166736200000e+l 

1.026166e+l 

-9.712186808000000e+0 

—9.712186e+0 

4.594164261000004e+0 

4.594164e+0 

—8.689086648000011e—1 

-8.689086e—1 


The poles of H(z) all lie within the unit circle, and the designed filter is thus stable. However, if we use the 
truncated coefficients A* k to compute the roots, the filter becomes unstable because one pole moves out of 
the unit circle! The bottom line is that stability is an important issue in the design of HR digital filters. 

9.8.3 Concluding Remarks 

HR filters are well suited to applications requiring frequency-selective filters with sharp cutoffs or where linear 
phase is relatively unimportant. Examples include graphic equalizers for digital audio, tone generators for 
digital touch-tone receivers, and filters for digital telephones. The main advantages are standardized easy 
design, and low filter order. On the other hand, HR filters cannot exhibit linear phase and are quite 
susceptible to the effects of coefficient quantization. If linear phase is important as in biomedical signal 
processing, or stability is paramount as in many adaptive filtering schemes, it is best to use FIR filters. 
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CHAPTER 9 PROBLEMS 


9.1 (Response Invariance) Consider the analog filter H(s ) = -. 

s + 2 

(a) Convert H(s) to a digital filter H(z), using impulse invariance. Assume that the sampling 
frequency is S = 2 Hz. 

(b) Will the impulse response h[n\ match the impulse response h(t) of the analog filter at the sampling 
instants? Should it? Explain. 

(c) Will the step response s[n] match the step response s(t) of the analog filter at the sampling 
instants? Should it? Explain. 


[Hints and Suggestions: For part (a), find h(t), sample it (t —> nt s ) to get h[n\ and find its 21 - 
transform to obtain H(z).] 


9.2 (Response Invariance) Consider the analog filter ! I (s) = --. 

S ~\~ 2 

(a) Convert H(s) to a digital filter H(z), using step invariance at a sampling frequency of S = 2 Hz. 

(b) Will the impulse response h[n\ match the impulse response h(t) of the analog filter at the sampling 
instants? Should it? Explain. 

(c) Will the step response s[n] match the step response s(t) of the analog filter at the sampling 
instants? Should it? Explain. 


[Hints and Suggestions: For part (a), find y(t) from Y(s) = H(s)X(s ) = H(s)/s, sample it (t —> nt s ) 
to get y[n] and find the ratio H{z) = Y{z)/X{z) where x[n] = u[n}.] 

9.3 (Response Invariance) Consider the analog filter H{s) = - . 

s + 2 

(a) Convert H(s) to a digital filter H(z), using ramp invariance at a sampling frequency of S = 2 Hz. 

(b) Will the impulse response h[n\ match the impulse response h(t) of the analog filter at the sampling 
instants? Should it? Explain. 

(c) Will the step response s[n] match the step response s(t) of the analog filter at the sampling 
instants? Should it? Explain. 

(d) Will the response v[n] to a unit ramp match the unit-ramp response v(t) of the analog filter at 
the sampling instants? Should it? Explain. 


[Hints and Suggestions: For part (c), find y(t) from F(s) = H(s)X(s) = H(s)/s 2 , sample it 
(t —> nt s ) to get y[n] and find the ratio H(z) = Y(z)/X(z) where x[ri\ = nt s u[n}.} 


9.4 (Response Invariance) Consider the analog filter H(s) = 


s + 1 


(s + l) 2 + 7T 2 

(a) Convert H(s) to a digital filter H{z), using impulse invariance. Assume that the sampling 
frequency is S' = 2 Hz. 

(b) Convert H(s) to a digital filter H(z ), using invariance to the input x(t) = e t u(t) at a sampling 
frequency of S = 2 Hz. 


[Hints and Suggestions: For part (c), find y(t) from E(s) = H(s)X(s) = H(s)/(s + 1), sample it 
(t —> nt s ) to get y[n] and find the ratio H(z) = Y{z)/X{z) where x[n] = e~ nts u[n} = ( e~ ts ) n .] 
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9.5 (Impulse Invariance) Use the impulse-invariant transformation with t s = 1 s to transform the 
following analog filters to digital filters. 


(a) H(s) = 


s -b 2 


(b) H(s) = 


s + 1 


2 

s H- 2 


(c) H(s) = 


1 

(s + 1) (s + 2) 


[Hints and Suggestions: For (c), find the partial fractions for H(s). For all, use the transformation 
=>■ ~—e- at * f° r eac ^ partial fraction term.] 


9.6 (Impulse-Invariant Design) We are given the analog lowpass filter H{s ) = -- whose cutoff 

s I 1 

frequency is known to be 1 rad/s. It is required to use this filter as the basis for designing a digital 
filter by the impulse-invariant transformation. The digital filter is to have a cutoff frequency of 50 Hz 
and operate at a sampling frequency of 200 Hz. 


(a) What is the transfer function H{z) of the digital filter if no gain matching is used? 

(b) What is the transfer function H(z) of the digital filter if the gain of the analog filter and dig¬ 
ital filter are matched at dc? Does the gain of the two filters match at their respective cutoff 
frequencies? 

(c) What is the transfer function H(z) of the digital filter if the gain of the analog filter at its cutoff 
frequency (1 rad/s) is matched to the gain of the digital filter at its cutoff frequency (50 Hz)? 
Does the gain of the two filters match at dc? 


[Hints and Suggestions: For (a), pick Vic = 27r/c/S, obtain H A (s ) = H(s/£lc) and convert to H(z) 
using ^ => 2 _ e - at „ ■ For (b), find G A = |H(s)| s =o, G D = \H(z)\ z =i and multiply H(z) by G A /G D . 
For (c), find G A = |H(s)| s= ji and Gd = \H(z)\ at z = e J 27r ( 50 )/ s ' and multiply H(z) by G a /Gd-} 


9.7 (Impulse Invariance) The impulse-invariant method allows us to take a digital filter described by 
z z 

Hi(z) = --- at a sampling interval of t-\ and convert this to a new digital filter # 2 ( 2 ) = - 

z — at A z — at 2 

at a different sampling interval t-2- 

(a) Using the fact that s = = ^ n ( a ^) ^ g j 10w ^at a f 2 = ( a ^ 1 ) M ) where M = ^/U- 

1 1 <2 

z z 

(b) Use the result of part (a) to convert the digital filter Hi ( 2 ) = —^7^ H-with t s = Is, 


to a digital filter H 2 (z ), with t s = 0.5s. 


2-0.5 2-0.25 


9.8 


(Matched 2 - Transform) Use the matched 2 -transform s + a =>■ -, with t s = 0.5 s and 

2 

gain matching at dc, to transform each analog filter H{z) to a digital filter H{z). 


(a) H(s) = ^ (b) H(s) 

(c) H(s) = H (d)H(s) 

s + 1 s + 2 


1 

(s + 1) (s + 2) 
s + 1 

(s + l) 2 + 7 r 2 


[Hints and Suggestions: Set up H(s) in factored form and use (s + a) => z e -- for each factor to 

obtain H{z). Then, find G A = |H(s)| s= o, Gd = \H(z)\ z -i and multiply H(z) by G a /Gd] 


9.9 (Matched 2 - Transform) The analog filter H(s ) 
filter H(z) at a sampling rate of S' = 4 Hz. 
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(a) Convert H(s) to a digital filter, using the matched 2 -transform s + a => -. 

(b) Convert H(s) to a digital filter, using the modified matched 2 -transform by moving all zeros at 
the origin (z = 0 ) to z = — 1 . 

(c) Convert H(s ) to a digital filter, using the modified matched 2 -transform, by moving a 11 but one 
zero at the origin (2 = 0) to 2 = — 1 . 


9.10 (Backward Euler Algorithm) The backward Euler algorithm for numerical integration is given by 
y[n\ = y[n - 1 ] + t s x[n\. 

(a) Derive a mapping rule for converting an analog filter to a digital filter, based on this algorithm. 

4 

(b) Apply the mapping to convert the analog filter H(s ) = - to a digital filter H(z ), using a 

s + 4 

sampling interval of t s = 0.5 s. 


[Hints and Suggestions: For (a), find H(z) and compare with H(s ) = 1/s (ideal integrator).] 

9.11 (Mapping from Difference Algorithms) Consider the analog filter H(s) = -. 

s + a 

(a) For what values of a is this filter stable? 

(b) Convert H(s ) to a digital filter H(z), using the mapping based on the forward difference at a 
sampling rate S. Is H{z) always stable if H{s) is stable? 

(c) Convert H{s) to a digital filter H(z), using the mapping based on the backward difference at a 
sampling rate S. Is H{z) always stable if H{s) is stable? 


[Hints and Suggestions: For (b)-(c), find H(z) from the difference equations for the forward and 
backward difference respectively and compare with H(s) = s (ideal differentiator).] 

9.12 (Simpson’s Algorithm) Simpson’s numerical integration algorithm is described by 

y[n] = y[n — 2] + y (a:[?r] + 4 x[n — 1] + x[n — 2]) 

(a) Derive a mapping rule to convert an analog filter H(s ) to a digital filter H(z), based on this 
algorithm. 

(b) Let H(s) = --. Convert H(s) to H(z), using the mapping derived in part (a). 

s 1 

(c) Is the filter H(z) designed in part (b) stable for any choice of t s > 0? 


9.13 (Response of Numerical Algorithms) Simpson’s and Tick’s rules for numerical integration find 
y[k\ (the approximation to the area) over two time steps from y[k — 2 ] and are described by 

, r i r x\ n \ + 4x[n — 1 ] + x\n — 2 ] 

Simpson’s rule: y[n\ = y[n — 2] H- 7 - 

O 

Tick’s rule: y[n] = y[n — 2] + 0.3584cc[n] + 1.2832x[n — 1] + 0.3584cr[n — 2] 

(a) Find the transfer function H{F ) corresponding to each rule. 

(b) For each rule, sketch \H(F)\ over 0 < F < 0.5 and compare with the spectrum of an ideal 
integrator. 

(c) It is claimed that the coefficients in Tick’s rule optimize H(F) in the range 0 < F < 0.25. Does 
your comparison support this claim? 

3 

9.14 (Bilinear Transformation) Consider the lowpass analog Bessel filter H(s ) = —-. 

T 3s T 3 
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(a) Use the bilinear transformation to convert this analog filter H(s) to a digital filter H(z ) at a 
sampling rate of S = 2 Hz. 

(b) Use H(s) and the bilinear transformation to design a digital lowpass filter H(z) whose gain at 
fo = 20 kHz matches the gain of H(s) at w a = 3 rad/s. The sampling frequency is S = 80 kHz. 


[Hints and Suggestions: For (b), use s =>• CJrq with C tan(27r/o/*S l ) = w a -} 


9.15 (Bilinear Transformation) Consider the analog filter H(s) 


s 

s 2 + s + 1 


(a) What type of filter does H(s) describe? 

(b) Use H(s ) and the bilinear transformation to design a digital filter H(z) operating at S' = 1 kHz 
such that its gain at /o = 250 Hz matches the gain of H(s) at to a = 1 rad/s. What type of filter 
does H(z) describe? 

(c) Use H(s ) and the bilinear transformation to design a digital filter H(z) operating at S = 10 Hz 
such that gains of H(z) and H(s ) match at f m = 1 Hz. What type of filter does H(z) describe? 


[Hints and Suggestions: For (a), use s => Cfrj with Ctan(2n f 0 /S) = w a - For (b), use s => C §q-( 
with Ctan(2nf m /S) = 2n<j) m .] 

9.16 (Bilinear Transformation) A second-order Butterworth lowpass analog filter with a half-power 
frequency of 1 rad/s is converted to a digital filter H(z), using the bilinear transformation at a sampling 
rate of S = 1 Hz. 

(a) What is the transfer function H(s) of the analog filter? 

(b) What is the transfer function H(z) of the digital filter? 

(c) Are the dc gains of H(z) and H(s) identical? Should they be? Explain. 

(d) Are the gains of H(z) and H(s) at their respective half-power frequencies identical? Explain. 


9.17 (IIR Filter Design) Lead-lag systems are often used in control systems and have the generic form 
H(s) = ^-—-. Use a sampling frequency of 5 = 10 Hz and the bilinear transformation to design IIR 
filters from this lead-lag compensator if 
(a) n = 1 s, r 2 = 10 s. (b) n = 10 s, T 2 = 1 s. 


9.18 (Spectral Transformation of Digital Filters) The digital lowpass filter H(z) = - has 

z 1 — z + 0.2 

a cutoff frequency / = 0.5 kHz and operates at a sampling frequency S = 10 kHz. Use this filter to 
design the following: 


(a) A lowpass digital filter with a cutoff frequency of 2 kHz 

(b) A highpass digital filter with a cutoff frequency of 1 kHz 

(c) A bandpass digital filter with band edges of 1 kHz and 3 kHz 

(d) A bandstop digital filter with band edges of 1.5 kHz and 3.5 kHz 


[Hints and Suggestions: Use the tables for digital-to-digital (D2D) transformations.] 

2 

9.19 (Spectral Transformation of Analog Prototypes) The analog lowpass filter H(s ) = —- 

s A 2s A 2 

has a cutoff frequency of 1 rad/s. Use this prototype to design the following digital filters. 

(a) A lowpass filter with a passband edge of 100 Hz and 5=1 kHz 

©Ashok Ambardar, September 1, 2003 




402 


Chapter 9 Design of HR Filters 


(b) A highpass filter with a cutoff frequency of 500 Hz and 5 = 2 kHz 

(c) A bandpass filter with band edges at 400 Hz and 800 Hz, and 5 = 3 kHz 

(d) A bandstop filter with band edges at 1 kHz and 1200 Hz, and 5 = 4 kHz 

[Hints and Suggestions: Use the tables for analog-to-digital (A2D) transformations.] 

9.20 (Notch Filters) A notch filter is required to remove 50-Hz interference. Assuming a bandwidth of 
4 Hz and a sampling rate of 300 Hz, design the simplest such filter using the bilinear transformation. 
Compute the filter gain at 40 Hz, 50 Hz, and 60 Hz. 

[Hints and Suggestions: Use the standard form of the second-order notch filter.] 

9.21 (Peaking Filters) A peaking filter is required to isolate a 100-Hz signal with unit gain. Assuming 
a bandwidth of 5 Hz and a sampling rate of 500 Hz, design the simplest such filter using the bilinear 
transformation. Compute the filter gain at 90 Hz, 100 Hz, and 110 Hz. 

[Hints and Suggestions: Use the standard form of the second-order peaking (bandpass) filter.] 

9.22 (IIR Filter Design) A fourth-order digital filter operating at a sampling frequency of 40 kHz is 
required to have a passbancl between 8 kHz and 12 kHz and a maximum passbancl ripple that equals 
5% of the peak magnitude. Design the digital filter using the bilinear transformation. 

[Hints and Suggestions: You need a Chebyshev bandpass filter of order 4. So, start with a Chebyshev 
analog lowpass prototype of order 2 (not 4) and apply A2D transformations.] 

9.23 (IIR Filter Design) Design IIR filters that meet each of the following sets of specifications. Assume 
a passbancl attenuation of A p = 2 dB and a stopband attenuation of A s = 30 dB. 

(a) A Butterworth lowpass filter with passband edge at 1 kHz, stopband edge at 3 kHz, and 5 = 
10 kHz, using the backward Euler transformation. 

(b) A Butterworth highpass filter with passband edge at 400 Hz, stopband edge at 100 Hz, and 
5 = 2 kHz, using the impulse-invariant transformation. 

(c) A Chebyshev bandpass filter with passband edges at 800 Hz and 1600 Hz, stopband edges at 
400 Hz and 2 kHz, and 5 = 5 kHz, using the bilinear transformation. 

(d) An inverse Chebyshev bandstop filter with passband edges at 200 Hz and 1.2 kHz, stopband 
edges at 500 Hz and 700 Hz, and 5 = 4 kHz, using the bilinear transformation. 


[Hints and Suggestions: Normalize all frequencies. For (a)-(b), design an analog lowpass prototype 
at luc = 1 rad/s, convert to a digital prototype at 5 = 1 Hz, and use digital-to-digital (D2D) transfor¬ 
mations with fi c = 1- For (c)-(d), design the analog lowpass prototype using prewarped frequencies. 
Then, apply A2D transformations using unwarped digital band edges.] 


9.24 


(Digital-to-Analog Mappings) In addition to the bilinear transformation, the backward Euler 
method also allows a linear mapping to transform a digital filter H{z) to an analog equivalent H{s). 


(a) Develop such a mapping based on the backward Euler algorithm. 

Z 

(b) Use this mapping to convert a digital filter H(z) = ——— operating at 5 = 2 Hz to its analog 


equivalent H(s). 


z- 0.5 


9.25 (Digital-to-Analog Mappings) The forward Euler method also allows a linear mapping to transform 
a digital filter H(z) to an analog equivalent H(s). 

(a) Develop such a mapping based on the forward Euler algorithm. 
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(b) Use this mapping to convert a digital filter H(z) — —-— operating at S = 2 Hz to its analog 

2 — 0.5 

equivalent H(s). 


9.26 (Digital-to-Analog Mappings) Two other methods that allow us to convert a digital filter H(z) to 

2 — e~ ats 


an analog equivalent H{z) are impulse invariance and the matched 2 -transform s + a 

2 

z(z H - 1 ) 

Let H(z) = ---——--. Find the analog filter H(s) from which H(z) was developed, assuming 

(z 0.25) (2 0.5) 

a sampling frequency of S = 2 Hz and 

(a) Impulse invariance. (b) Matched 2 -transform. (c) Bilinear transformation. 

9.27 (Digital-to-Analog Mappings) The bilinear transformation allows us to use a linear mapping to 
transform a digital filter H(z) to an analog equivalent H(s). 


(a) Develop such a mapping based on the bilinear transformation. 


(b) Use this mapping to convert a digital filter H(z) = 
equivalent H(s). 


2-0.5 


operating at S = 2 Hz to its analog 


9.28 (Group Delay) A digital filter H{z ) is designed from an analog filter H(s), using the bilinear 
transformation u>a = Ctan(f 2 £>/ 2 ). 

(a) Show that the group delays T g (u>A) and T g (Q o) of H(s) and H(z) respectively are related by 

T g (n D ) =0.5C(l+LO 2 A )T g (u;A) 

5 

(b) Design a digital filter H(z) from the analog filter H(s ) = -- at a sampling frequency of 

s T 5 

S' = 4 Hz such that the gain of H(s) at to = 2 rad/s matches the gain of H(z) at 1 Hz. 

(c) What is the group delay T g (u>A) of the analog filter H(s)l 

(d) Use the results to find the group delay T g {VLo) of the digital filter H(z) designed in part (b). 


9.29 (Pade Approximations) A delay of t s may be approximated by e Sts w 1 — st s + —C-• • •. An 

nth-order Pade approximation is based on a rational function of order n that minimizes the truncation 
error of this approximation. The first-order and second-order Pade approximations are 


Pi(s) 


1 - \St s 

1 + \ s ts 


1 - \st s + Joists) 2 
1 + \st s + Y^(sf s ) 2 


Since e Sts describes a delay of one sample (or 2 1 ), Pade approximations can be used to generate 
inverse mappings for converting a digital filter H(z) to an analog filter H(s). 


( a ) 

(b) 

(c) 


Generate mappings for converting a digital filter H(z) to an analog filter H(s ) based on the 
first-order and second-order Pade approximations. 

% 

Use each mapping to convert H(z) = - to H(s), assuming t s = 0.5 s. 

2 — 0.5 


Show that the first-order mapping is bilinear. Is this mapping related in any way to the bilinear 
transformation? 
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COMPUTATION AND DESIGN 


9.30 (HR Filter Design) It is required to design a lowpass digital filter H(z) from the analog filter 
H(s) = D-y. The sampling rate is S' = 1 kHz. The half-power frequency of H(z) is to be f lc = 7r/4. 

(a) Use impulse invariance to design H(z) such that gain of the two filters matches at dc. Compare 
the frequency response of both filters (after appropriate frequency scaling). Which filter would 
you expect to yield better performance? To confirm your expectations, define the (in-band) signal 
to (out-of-band) noise ratio (SNR) in dB as 


SNR =20 



signal level 
noise level 


dB 


(b) What is the SNR at the input and output of each filter if the input is 

x(t) = cos(0.2wc4) + cos(1.2wcd) for H(s) and x[n] = cos(0.2nflc) + cos(1.2?rflc) for H(z)l 

(c) What is the SNR at the input and output of each filter if the input is 

x(t) = cos(0.2 uct) + cos(3 ixct) for H(s) and x[n ] = cos(0.2?rflc) + cos(3nflc) for H{z)l 

(d) Use the bilinear transformation to design another filter Hi(z) such that gain of the two filters 
matches at dc. Repeat the computations of parts (a) and (b) for this filter. Of the two digital 
filters H{z) and H\(z), which one would you recommend using, and why? 


9.31 (IIR Filter Design) A digital filter is required to have a monotonic response in the passband and 
stopband. The half-power frequency is to be 4 kHz, and the attenuation past 5 kHz is to exceed 20 
dB. Design the digital filter, using impulse invariance and a sampling frequency of 15 kHz. 

9.32 (The Effect of Group Delay) The nonlinear phase of IIR filters is responsible for signal distortion. 
Consider a lowpass filter with a 1-dB passband edge at / = 1 kHz, a 50-dB stopband edge at / = 2 kHz, 
and a sampling frequency of S = 10 kHz. 

(a) Design a Butterworth filter Hb{z) and an elliptic filter He(z ) to meet these specifications. Using 
the Matlab routine grpdelay (or otherwise), compute and plot the group delay of each filter. 
Which filter has the lower order? Which filter has a more nearly constant group delay in the 
passband? Which filter would cause the least phase distortion in the passband? What are the 
group delays Nb and Ne (expressed as the number of samples) of the two filters? 

(b) Generate the signal x[n ] = 3sin(0.03ri7r) + sin(0.09?r7r) + 0.6 sin(0.15n7r) over 0 < n < 100. Use 
the ADSP routine filter to compute the response y n [«,] and yE[n} of each filter. Plot the filter 
outputs j/s[n] and y^n] (delayed by Nb and Ne, respectively) and the input x[n\ on the same 
plot to compare results. Does the filter with the more nearly constant group delay also result in 
smaller signal distortion? 

(c) Are all the frequency components of the input signal in the filter passband? If so, how can 
you justify that the distortion is caused by the nonconstant group delay and not by the filter 
attenuation in the passband? 


9.33 (LORAN) A LORAN (long-range radio and navigation) system for establishing positions of marine 
craft uses three transmitters that send out short bursts (10 cycles) of 100-kHz signals in a precise phase 
relationship. Using phase comparison, a receiver (on the craft) can establish the position (latitude and 
longitude) of the craft to within a few hundred meters. Suppose the LORAN signal is to be digitally 
processed by first sampling it at 500 kHz and filtering the sampled signal using a second order peaking 
filter with a half-power bandwidth of 100 Hz. Use the bilinear transformation to design the filter from 
an analog filter with unit half-power frequency. Compare your design with the digital filter designed 
in Problem 18.34 (to meet the same specifications). 
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9.34 (Decoding a Mystery Message) During transmission, a message signal gets contaminated by a 
low-frequency signal and high-frequency noise. The message can be decoded only by displaying it in 
the time domain. The contaminated signal x[n] is provided on the author’s website as mysteryl .mat. 
Load this signal into Matlab (use the command load mysteryl). In an effort to decode the message, 
try the following methods and determine what the decoded message says. 

(a) Display the contaminated signal. Can you “read” the message? Display the DFT of the signal 
to identify the range of the message spectrum. 

(b) Use the bilinear transformation to design a second-order HR bandpass filter capable of extracting 
the message spectrum. Filter the contaminated signal and display the filtered signal to decode 
the message. Use both the filter (filtering) and filifilt (zero-phase filtering) commands. 

(c) As an alternative method, first zero out the DFT component corresponding to the low-frequency 
contamination and obtain the IDFT y[n\. Next, design a lowpass HR filter (using impulse invari¬ 
ance) to reject the high-frequency noise. Filter the signal y[n] and display the filtered signal to 
decode the message. Use both the filter and filtfilt commands. 

(d) Which of the two methods allows better visual detection of the message? Which of the two 
filtering routines (in each method) allows better visual detection of the message? 

9.35 (Interpolation) The signal x[n ] = cos(27rFo?i) is to be interpolated by 5 using up-sampling followed 
by lowpass filtering. Let F 0 = 0.4. 

(a) Generate and plot 20 samples of x[n ] and up-sample by 5. 

(b) What must be the cutoff frequency Fq and gain A of a lowpass filter that follows the up-sampler 
to produce the interpolated output? 

(c) Design a fifth-order digital Butterworth filter (using the bilinear transformation) whose half-power 
frequency equals Fq and whose peak gain equals A. 

(d) Filter the up-sampled signal through this filter and plot the result. Is the result an interpolated 
version of the input signal? Do the peak amplitudes of the interpolated signal and original signal 
match? Should they? Explain. 

9.36 (Coefficient Quantization) Consider the analog filter described by 

(s + 0.5)(s + 1.5) 

[S> (s+l)(s + 2)(s + 4.5)(s + 8)(s+12) 

(a) Is this filter stable? Why? 

(b) Use the bilinear transformation with S = 100 Hz to convert this to a digital filter H(z). 

(c) Truncate the filter coefficients to seven significant digits to generate the filter F[- 2 (z). 

(d) Compare the frequency response of F[{z) and H 2 (z). Are there any significant differences? 

(e) Is the filter F[ 2 (z) stable? Should it be? Explain. 

(f) Suppose the coefficients are to be quantized to B bits by rounding. What is the smallest number 
of bits B required in order to preserve the stability of the quantized filter? 

9.37 (Numerical Integration Algorithms) It is claimed that mapping rules to convert an analog filter to 
a digital filter, based on numerical integration algorithms that approximate the area y[n} from y[n— 2] 
or y[n — 3] (two or more time steps away), do not usually preserve stability. Consider the following 
integration algorithms. 

(1) y[n] = y[n — 1] + |§(5x[n] + 8x[n — 1] — x[n — 2]) (Adams-Moulton rule) 

(2) y[n] = y[n — 2] + ^(x[n\ + 4 x[n — 1] + x[n — 2]) (Simpson’s rule) 
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(3) y[n] = y[n — 3] + ^(^[n] + 3 x\n — 1] + 3a:[?r — 2] + x[n — 3]) (Simpson’s three-eighths rule) 
Derive mapping rules for each algorithm, convert the analog filter H(s) = -- to a digital filter 

5 + 1 

using each mapping with 5 = 5 Hz, and use Matlab to compare their frequency response. Which of 
these mappings (if any) allow us to convert a stable analog filter to a stable digital filter? Is the claim 
justified? 

9.38 (RIAA Equalization) Audio signals usually undergo a high-frequency boost (and low-frequency 
cut) before being used to make the master for commercial production of phonograph records. During 
playback, the signal from the phono cartridge is fed to a preamplifier (equalizer) that restores the 
original signal. The frequency response of the preamplifier is based on the RIAA (Recording Industry 
Association of America) equalization curve whose Bode plot is shown in Figure P9.38, with break 
frequencies at 50, 500, and 2122 Hz. 


// dB RIAA equalization curve 



l_i_i_i_ 

50 500 2122 f Hz (log) 

Figure P9.38 Figure for Problem 9.38 

(a) What is the transfer function H(s) of the RIAA equalizer? 

(b) It is required to implement RIAA equalization using a digital filter. Assume that the signal from 
the cartridge is band-limited to 15 kHz. Design an HR filter Hi(z), using impulse invariance, 
that implements the equalization characteristic. 

(c) Use the bilinear transformation to design an HR filter Hb{z) that implements the equalization 
characteristic. Assume that the gain of H(s ) and Hb{z ) are to match at 1 kHz. 

(d) Compare the performance of H(s) with Hb{z) and Hj(z) and comment on the results. Which 
HR design method results in better implementation? 

9.39 (Audio Equalizers) Many hi-fi systems are equipped with graphic equalizers to tailor the frequency 
response. Consider the design of a four-band graphic equalizer. The first section is to be a lowpass filter 
with a passband edge of 300 Hz. The next two sections are bandpass filters with passband edges of 
[300, 1000] Hz and [1000, 3000] Hz, respectively. The fourth section is a highpass filter with a passband 
edge at 3 kHz. The sampling rate is to be 20 kHz. Implement this equalizer, using FIR filters based on 
window design. Repeat the design, using an optimal FIR filter. Repeat the design, using an HR filter 
based on the bilinear transformation. For each design, superimpose plots of the frequency response of 
each section and their parallel combination. What are the differences between HR and FIR design? 
Which design would you recommend? 
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THE DISCRETE FOURIER 
TRANSFORM AND ITS 
APPLICATIONS 


10.0 Scope and Objectives 

This chapter introduces the discrete Fourier transform (DFT) as a means of examining sampled signals in 
the frequency domain. It describes the DFT, its properties and its relationship to other frequency domain 
transforms. It discusses efficient algorithms for implementing the DFT that go by the generic name of fast 
Fourier transforms (FFTs). It concludes with applications of the DFT and FFT to digital signal processing. 


10.1 Introduction 

The processing of analog signals using digital methods continues to gain widespread popularity. The Fourier 
series of analog periodic signals and the DTFT of discrete-time signals are duals of each other and are similar 
in many respects. In theory, both offer great insight into the spectral description of signals. In practice, both 
suffer from (similar) problems in their implementation. The finite memory limitations and finite precision of 
digital computers constrain us to work with a finite set of quantized numbers for describing signals in both 
time and frequency. This brings out two major problems inherent in the Fourier series and the DTFT as 
tools for digital signal processing. Both typically require an infinite number of samples (the Fourier series 
for its spectrum and the DTFT for its time signal). Both deal with one continuous variable (time t or digital 
frequency F). A numerical approximation that can be implemented using digital computers requires that 
we replace the continuous variable with a discrete one and limit the number of samples to a finite value in 
both domains. 

10.1.1 Connections Between Frequency-Domain Transforms 

Sampling and duality provide the basis for the connection between the various frequency-domain transforms 
and the concepts are worth repeating. Sampling in one domain induces a periodic extension in the other. 
The sample spacing in one domain is the reciprocal of the period in the other. Periodic analog signals have 
discrete spectra, and discrete-time signals have continuous periodic spectra. A consequence of these concepts 
is that a sequence that is both discrete and periodic in one domain is also discrete and periodic in the other. 
This leads to the development of the discrete Fourier transform (DFT) and discrete Fourier series 
(DFS), allowing us a practical means of arriving at the sampled spectrum of sampled signals using digital 
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computers. The connections are illustrated in Figure 10.1 and summarized in Table 10.1. 


Nonperiodic analog signal 



Fourier transform 


Nonperiodic spectrum 







Figure 10.1 Features of the various transforms 


Table 10.1 Connections Between Various Transforms 


Operation in the Time Domain 

Result in the Frequency Domain 

Transform 

Aperiodic, continuous x(t) 

Aperiodic, continuous X(f) 

FT 

Periodic extension of x(t) =4- x p (t) 
Period = T 

Sampling of X(f) =» X[k] 

Sampling interval = 1/T = /o 

FS 

Sampling of x p (t) => x p [n] 

Sampling interval = t a 

Periodic extension of X[k] => Adfs[&] 
Period = S = l/t s 

DFS 

Sampling of x(t) => x[n} 

Sampling interval = 1 

Periodic extension of X(f) => X(F) 
Period = 1 

DTFT 

Periodic extension of x[n ] =4> x p [n ] 
Period = N 

Sampling of X(F) => ADFT[fc] 

Sampling interval = 1/N 

DFT 


Since sampling in one domain leads to a periodic extension in the other, a sampled representation in 
both domains also forces periodicity in both domains. This leads to two slightly different but functionally 
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equivalent sets of relations, depending on the order in which we sample time and frequency, as listed in 
Table 10.2. If we first sample an analog signal x(t), the sampled signal has a periodic spectrum X(F) (the 
DTFT), and sampling of X(F) leads to the DFT representation. If we first sample the Fourier transform 
X(f) in the frequency domain, the samples represent the Fourier series coefficients of a periodic time signal 
x p (t ), and sampling of x p (t) leads to the discrete Fourier series (DFS) as the periodic extension of the 
frequency-domain samples. The DFS differs from the DFT only by a constant scale factor. 


Table 10.2 Relating Frequency-Domain Transforms 


Fourier Transform 

/ 

\ 

Aperiodic/continuous signal: 

/>oo 

x(t)= X{f)e j2 * ft df 

J— oo 

Aperiodic/continuous spectrum: 

nOO 

X(f)= / x(t)e~ j27rft dt 

J —oo 

n 

Sampling x(t) (DTFT) 

V 

Sampling X(f) (Fourier series) 

Sampled time signal: 
x[n] = J X(F)e j2 ™ F dF 

Periodic spectrum (period = 1): 

OO 

X(F)= J2 x [ n ] e ~ j2vnF 

71 —— OO 

Sampled spectrum: 
X[k\= l -j T X p{ t)e-^dt 
Periodic time signal (period = T ): 

OO 

x P (t)= 53 X[k}e j2 ” kfot 

k=—oo 

Sampling X P (F) (DFT) 

V 

Sampling x p (t) (DFS) 

Sampled/periodic spectrum: 
N—l 

Xj, FT [k] = 53 x\n\e-^ nk ' N 

n—0 

Sampled/periodic time signal: 
i JV-i 

x[n\ = - 53 X» FT [k]e j2 ™ k ' N 

k=0 

Sampled/periodic time signal: 

N-l 

x[n\ = 53 X DFS [ k]eP 2mk / N 

k—0 

Sampled/periodic spectrum: 

i N ~ 1 

^dfsM = ^ 53 x[n\e-* 2 ™ k / N 

n—0 


10.2 The DFT 

The TV-point discrete Fourier transform (DFT) Xdft[^] of an TV-sample signal x[n] and the inverse 
discrete Fourier transform (IDFT), which transforms Adft[&] to x[n\, are defined by 

N-l 

X DFT [fc] = x[n]e~ j2mk/N , fc = 0,1,2,..., TV — 1 (10.1) 

n—0 

i N - 1 

x[n] = -£\Y DFT [k\eP 2mk/N , n = 0 , 1 , 2 ,... - 1 ( 10 . 2 ) 

k =0 
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Each relation is a set of N equations. Each DFT sample is found as a weighted sum of all the samples in x[n\. 
One of the most important properties of the DFT and its inverse is implied periodicity. The exponential 
exp(±j'27rn/c/fV) in the defining relations is periodic in both n and k with period N: 


g j2nnk/N ^ j27r(n-\-N)k/N ^j2nn(k-\-N)/N 


(10.3) 


As a result, the DFT and its inverse are also periodic with period N, and it is sufficient to compute the 
results for only one period (0 to N — 1). Both x[n ] and Adft[^] have a starting index of zero. 


REVIEW PANEL 10.1 

The X-point DFT and X-Point IDFT Are Periodic with Period X 

N-l N-l 

Xv FT [k}=Y, x We~ j2 ™ k/N , & = 0 , 1 , 2 , . 1 x[n\ = - ^X DFT [fc]e J “ /JV , n = 0 , 1 , 2 , ..., N-l 

n—0 k —0 


EXAMPLE 10.1 (DFT from the Defining Relation) 


1, 0 }. 

With N = 

4, and e o 2vnk / N = e jnkn/ 2 , we successively compute 

k = 0 : 

X D ft[0] 

3 

= ^2x[n}e° = l+2+l+0=4 

n—0 

k= 1: 

Adft[1] 

3 

= x[n]e~ jn * /2 = 1 + 2e~ j7r/2 + e~^ + 0 = -j2 

n—0 

k = 2 : 

X D ft[2] 

3 

= x l n } e ~ jnn = 1 + 2.e~ iv + e~ j27T + 0 = 0 

n—0 

k = 3: 

Adft[3] 

3 

= x[n]e- j3 ™ /2 = 1 + 2 e- j37r/2 + e~ j37T + 0 = j2 


n—0 


The DFT is thus Xdft[^'] = {4, —j 2, 0, j 2}. 


10.3 Properties of the DFT 

The properties of the DFT are summarized in Table 10.3. They are strikingly similar to other frequency- 
domain transforms, but must always be used in keeping with implied periodicity (of the DFT and IDFT) in 
both domains. 

10.3.1 Symmetry 

In analogy with all other frequency-domain transforms, the DFT of a real sequence possesses conjugate 
symmetry about the origin with Xdft[— k] = Xp FT [fc], Since the DFT is periodic, Xdft[— k] = AdftIA - —/ c]. 
This also implies conjugate symmetry about the index k = 0.5 N, and thus 

Adft[— k] = X(j FT [fc] = A D FT[fV — k] (10-4) 
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Table 10.3 Properties of the JV-Sample DFT 


Property 

Signal 

DFT 

Remarks 

Shift 

x[n — no] 

Vqft [k\e~^ kno > N 

No change in magnitude 

Shift 

x[n — 0.5IV] 

(—l) fc XnFT[fc] 

Half-period shift for even N 

Modulation 

x[n\e j2 ™ k °/ N 

Adft [k — k 0 ] 


Modulation 

(—1 ) n x[n} 

X DFT [k - 0.5N] 

Half-period shift for even N 

Folding 

x[—n\ 

Vdft[— k] 

This is circular folding. 

Product 

x[n\y[n} 

A A D ft [k] ©Tdft [k] 

The convolution is periodic. 

Convolution 

x[n]®y[n] 

Vdft [k] I DFT [k] 

The convolution is periodic. 

Correlation 

x[n]®®y[n] 

Vdft [fc] hpFT [k] 

The correlation is periodic. 

Central ordinates 

N-l N— 1 

,[0] = — ^ A D FT[fc] V D ft[0] = ^ x[n} 

k— 0 n= 0 

Central ordinates 

N-l N-l 

a ’[f] = y^(-l) fc VpFT[fc] {N even) V D ft[^] = ^](-l) n a:[n] (N even) 

k—0 n— 0 

Parseval’s relation 

N-l N-l 

E i*mi 2 = n E i^dftWi 2 

n—0 k—0 


Conjugate symmetry X[k] = X*[N-k] Conjugate symmetry X[k\ = X*[N—k\ 



0 f N -1 0 f Al-1 

N/2 N/2 

Figure 10.2 Symmetry of the DFT for real signals 


If N is odd, the conjugate symmetry is about the half-integer value 0.51V. The index k = 0.51V is called the 
folding index. This is illustrated in Figure 10.2. 

Conjugate symmetry suggests that we need compute only half the DFT values to find the entire DFT 
sequence—another labor-saving concept! A similar result applies to the IDFT. 



REVIEW PANEL 10.2 


The DFT Shows Conjugate Symmetry for Real Signals 

Vdft[— k] = A^ FT [fc] V D ft[— k] = 

Vdft [N ~ k] 


10.3.2 Central Ordinates and Special DFT Values 

The computation of the DFT at the indices k = 0 and (for even N) at k = A can be simplified using the 
central ordinate theorems that arise as a direct consequence of the defining relations. In particular, we find 
that Xdft[0] equals the sum of the N signal samples x[n], and Adft[w] equals the sum of (— l) n x[n] (with 
alternating sign changes). This also implies that if x[n] is real valued, so are Xdft[0] and XdftI^]- Similar 
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results hold for the IDFT. 


REVIEW PANEL 10.3 

The DFT Is Easy to Compute at k = 0 and (for Even N ) at fc = ^ 

N—l N-l N -1 N -1 

Adft[ 0] =y^N XDrr[%]=YX-V n x[n] ^[0] ^dftW x[%] =— y^(-l) fc A DF T[fc] 

n —0 n—0 k —0 k —0 


10.3.3 Circular Shift and Circular Symmetry 

The defining relation for the DFT requires signal values for 0 < n < N — 1. By implied periodicity, these 
values correspond to one period of a periodic signal. If we wish to find the DFT of a time-shifted signal 
x[n — no], its values must also be selected over (0, N—l) from its periodic extension. This concept is called 
circular shifting. To generate x[n — no], we delay x[ii) by no, create the periodic extension of the shifted 
signal, and pick N samples over (0, N — 1). This is equivalent to moving the last no samples of x[n] to 
the beginning of the sequence. Similarly, to generate x[n + no], we move the first no samples to the end 
of the sequence. Circular folding generates the signal x[—n] from x[n\. We fold x[n], create the periodic 
extension of the folded signal, and pick N samples of the periodic extension over (0, N — 1). 


REVIEW PANEL 10.4 

Generating One Period (0 < n < N) of a Circularly Shifted Periodic Signal 
To generate x[n — no]: Move the last no samples of x[n] to the beginning. 

To generate x[n + no]: Move the first no samples of x[n] to the end. 


Even symmetry of x[n ] requires that x[n ] = x[— n]. Its implied periodicity also means x[n] = x[N — n], 
and the periodic signal x[n\ is said to possess circular even symmetry. Similarly, for circular odd 
symmetry, we have x[n\ = — a:[IV — n]. 


| REVIEW PANEL 10.5 | 

Circular Symmetry for Real Periodic Signals with Period N 

Circular even symmetry: x[n] = x[N — n ] Circular odd symmetry: x[n] = — x[N — n] 


10.3.4 Convolution 

Convolution in one domain transforms to multiplication in the other. Due to the implied periodicity in both 
domains, the convolution operation describes periodic, not regular, convolution. This also applies to the 
correlation operation. 


REVIEW PANEL 10.6 

Multiplication in One Domain Corresponds to Discrete Periodic Convolution in the Other 


Periodic Convolution 

The DFT offers an indirect means of finding the periodic convolution y[n] = x[n]@h[n] of two sequences 
x[n] and h[n ] of equal length N. We compute their V-sample DFTs AdptI^] and Rdft[^'], multiply them 
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to obtain Pdft [k\ = ^dft [fc] 77dft [fe], and find the inverse of Ydft to obtain the periodic convolution y[n\: 


x[n]®h[n] 4=> XDFT[fc]ifDFT[fc] 


(10.5) 


Periodic Correlation 

Periodic correlation can be implemented using the DFT in almost exactly the same way as periodic convo¬ 
lution, except for an extra conjugation step prior to taking the inverse DFT. The periodic correlation of two 
sequences x[n] and h[n] of equal length TV gives 

r xh [n) = x[n] ®® h[n\ <t=>- X D FT[fc]#£ F T[ fc ] (10.6) 

If x[n\ and h[n] are real, the final result r x h[n} must also be real (to within machine roundoff). 

Regular Convolution and Correlation 

We can also find regular convolution (or correlation) using the DFT. For two sequences of length M and TV, 
the regular convolution (or correlation) contains M + N — 1 samples. We must thus pad each sequence with 
enough zeros, to make each sequence of length M + N — 1, before finding the DFT. 


| REVIEW PANEL 10.7 | 

Regular Convolution by the DFT Requires Zero-Padding 

If x[n] and h[n] are of length M and TV, create x z [n] and h z [n], each zero-padded to length M + TV — 1. 
Find the DFT of the zero-padded signals, multiply the DFT sequences, and find y[n] as the inverse. 


10.3.5 The FFT 

The DFT describes a set of TV equations, each with TV product terms and thus requires a total of TV 2 
multiplications for its computation. Computationally efficient algorithms to obtain the DFT go by the 
generic name FFT (fast Fourier transform) and need far fewer multiplications. In particular, radix-2 FFT 
algorithms require the number of samples TV to be a power of 2 and compute the DFT using only TV log 2 TV 
multiplications. We discuss such algorithms in a later section. 


REVIEW PANEL 10.8 

The FFT Describes Computationally Efficient Algorithms for Finding the DFT 

Radix-2 FFT algorithms require the number of samples TV to be a power of 2 (TV = 2 m , integer m). 


EXAMPLE 10.2 (DFT Computations and Properties) 

(a) Let y[n] = {1, 2, 3, 4, 5, 0, 0, 0}, n = 0,1,2,... ,7. Find one period of the circularly shifted signals 
f[n] = y[n — 2], g[n\ = y[n + 2], and the circularly folded signal h[n] = y[—n\ over 0 < n < 7. 

1. To create f[n] = y[n — 2], we move the last two samples to the beginning. So, 
f[n] = y[n - 2] = {0, 0, 1, 2, 3, 4, 5, 0}, n = 0,1,.... 7. 

2. To create g[n] = y[n + 2], we move the first two samples to the end. So, 
g[n\ = y[n + 2] = {3, 4, 5, 0, 0, 0, 1, 2}, n = 0,1,..., 7. 
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3. To create h[n] = y[—n], we fold y[n ] to {0, 0, 0, 5, 4, 3, 2, 1}, n = —7, —6, —5,..., 0 and create 
its periodic extension by moving all samples (except y[0]) past y[0] to get 
h[n] = y[—n\ = {1, 0, 0, 0, 5, 4, 3, 2}, n = 0,1,2,..., 7. 


(b) Let us find the DFT of x[n] = {1, 1, 0, 0, 0, 0, 0, 0}, n = 0,1,2,7. 

Since only rr[0] and x[\\ are nonzero, the upper index in the DFT summation will be n = 1 and the 
DFT reduces to 

l 

A DFT [fc] = x[n]e- j2nnk / s = 1 + e~^ k/4 , k = 0,1,2,..., 7 

n =0 

Since N = 8, we need compute A DFT [£;] only for k < 0.5IV = 4. Now, A DFT [0] = 1 + 1 = 2 and 
Xdft[4] = 1 — 1 = 0. For the rest (k = 1, 2, 3), we compute Adft[1] = 1 + e -J7r / 4 = 1.707 — j0.707, 
A dft [ 2] = 1 + e" i*/ 2 = 1 - j, and A DFT [3] = 1 + e~^l 4 = 0.293 - j0.707. 

By conjugate symmetry, Adft [ k ] = A FFT [N — k] = A FFT [8 — k]. This gives 

A dft [ 5] = A£ FT [3] = 0.293+j0.707, A DFT [6] = A£ FT [2] = 1 +j, A DFT [7] = A£ FT [1] = 1.707-^0.707. 
Thus, A DFT [fc] = {2, 1.707 —jO.707, 0.293-jO.707, 1 -j, 0, 1 +j, 0.293 + j0.707, 1.707 +j0.707}. 


(c) Consider the DFT pair x[n] = {1, 2, 1, 0} <+> AdptI^] = {4, —j 2, 0 ,j 2} with N = 4. 

1. (Time Shift) To find y[n] = a:[?i — 2], we move the last two samples to the beginning to get 
y[n\ = x[n - 2] = {1, 0, 1, 2}, n = 0,1, 2, 3. 

To find the DFT of y[n\ = x[n — 2], we use the time-shift property (with no = 2) to give 
y DFT [fc] = X DFT [fc]e-^ fc "o/ 4 = X DFT [fc]e-^ = {4, j2, 0, -j2}. 

2. (Modulation) The sequence ^d F t [fc] = AdptI^ — 1] equals {j2, 4, —j'2, 0}. Its IDFT is 
z[n] = x[?r]e j2 ’ I ' n / 4 = :r[?i]e J7m / 2 = {1, j2, —1, 0}. 

3. (Folding) The sequence g[n\ = x[—n\ is g[n\ = {x[0],a:[—l],x[— 2],x[— 3]} = {1, 0, 1, 2}. 

Its DFT equals GoFT[fe] = Adft[— k] = A FFT [fe] = {4, j2, 0, — j2}. 

4. (Conjugation) The sequence p[n\ = x*[n] is p[n] = x*[n] = x[n] = {1, 2, 1, 0}. Its DFT is 
P DFT [fe] = A£ FT [-fc] = {4, j2, 0, —j2}* = {4, —j2, 0, j2}. 

5. (Product) The sequence h[n] = a;[n]x[?r] is the pointwise product. So, h[n ] = {1, 4, 1, 0}. 

Its DFT is H DFT [k] = |A DFT [fc]©A DFT [fc] = \{4, -j2, 0, j2}©{4, -j2, 0, j2}. 

Keep in mind that this is a periodic convolution. 

The result is i7 D FT[fc] = |{24, -jl6, 0, J16} = {6, —j‘4, 0, j'l}. 

6. (Periodic Convolution) The periodic convolution c[n] = a;[n]©a;[n] gives 
c[n} = {1, 2, 1, 0}©{1, 2, 1, 0} = {2, 4, 6, 4}. 

Its DFT is given by the pointwise product 

CoFT[fc] = Ap) F T \k\ Adft [k] = {16, —4, 0, —4}. 

7. (Regular Convolution) The regular convolution s[n] = x[n] * x[n] gives 
s[n] = {1, 2, 1, 0}®{1, 2, 1, 0} = {1, 4, 6, 4, 1, 0, 0}. 

Since x[n] has 4 samples (N = 4), the DFT SoftI^] of s[n] is the product of the DFT of the 
zero-padded (to length N + N — 1 = 7) signal x z [n} = { 1, 2, 1, 0, 0, 0, 0} and equals 
{16, —2.35 — jlO.28, —2.18 + jl.05, 0.02 + j0.03, 0.02 - j0.03,-2.18 - jl.05,-2.35 + jl0.28}. 
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8. (Central Ordinates) It is easy to check that x[0] = \ 53 ^uft[ k] and Xdft[0] = 53 x l n \- 

9. (Parseval’s Relation) We have 53 \ x [ n ] | 2 = l + 4 + l + 0 = 6. 

Since Xp FT [fc] = {16, —4, 0, 4}, we also have \ 53 I^dft[^']| 2 = 1(16 + 4 + 4) = 6. 


10.3.6 Signal Replication and Spectrum Zero Interpolation 

In analogy with the DTFT and Fourier series, two useful DFT results are that replication in one domain 
leads to zero interpolation in the other. Formally, if x[n] <t=> XoftI^] form a DFT pair, M-fold replication 
of x[n\ to y[n] = {x[?r], x[n],... ,x[n]} leads to zero interpolation of the DFT to Tdft [k] = MX^>YT\k/M]. 
The multiplying factor M ensures that we satisfy Parseval’s theorem and the central ordinate relations. Its 
dual is the result that zero interpolation of x[n] to z[n] — x[n/M} leads to M-fold replication of the DFT to 

ZdFt[&] = (X D FT[fc],^DFT[fc], ■ • • ,X D FT[fc]}- 


REVIEW PANEL 10.9 

Replication in One Domain Corresponds to Zero Interpolation in the Other 
If a signal is replicated by M, its DFT is zero interpolated and scaled by M. 

If x[n] -<=>■ X DF T[fc], then {x[n\, x[n], ... ,x[n]} MXn FT [k/M]. 

'-v-' 

M-fold replication 

If a signal is zero-interpolated by M, its DFT shows M-fold replication. 

If x[n] <£=>■ Vqft [fc], then x[n/M] { Vf>ft [fc] > -^dft [fc] , ■ • • , Adft [&]}• 

s. ^3 v 

M-fold replication 


EXAMPLE 10.3 (Signal and Spectrum Replication) 

Let x[n] = {2, 3, 2, 1} and Xdft[&] = {8, — j2, 0, j2}. Find the DFT of the 12-point signal described by 
y[n\ = {x[n], x\n\, x[n]} and the 12-point zero-interpolated signal h[n] = x[n/3]. 

(a) Signal replication by 3 leads to spectrum zero interpolation and multiplication by 3. Thus, 

YdftM = 3A DFT [fc/3] = {24, 0, 0, -j6, 0, 0, 0, 0, 0, j6, 0, 0} 


(b) Signal zero interpolation by 3 leads to spectrum replication by 3. Thus, 


MoftM = {-Xdft[&], X DF t[A:], -Xdft[&]} = {8, —j 2, 0, j 2, 8, —j 2, 0, j 2, 8, —j 2, 0, j 2} 


10.3.7 Some Useful DFT Pairs 

The DFT of finite sequences defined mathematically often results in very unwieldy expressions and explains 
the lack of many “standard” DFT pairs. However, the following DFT pairs are quite useful and easy to 
obtain from the defining relation and properties: 

{1, 0, 0,..., 0} (impulse) 4=> {1, 1, 1,..., 1} (constant) (10.7) 
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{1, 1, 1,..., 1} (constant) 
a n (exponential) 
cos(2nnk 0 /N) (sinusoid) 


{ N , 0, 0,..., 0} (impulse) 

1 — a N 

1 — e -j2-rrk/N 

0.5NS[k - k 0 ] + 0.5 NS[k - (N 


k 0 )] (impulse pair) 


( 10 . 8 ) 

(10.9) 

( 10 . 10 ) 


The first result is a direct consequence of the defining relation. For the second result, the DFT is e^ 
the sum of N equally spaced vectors of unit length, and equals zero (except when k = 0). For the third 
result, we use the defining relation a n e ~ : > 2nnk f N and the fact that e^ 27Tk = 1 to obtain 


N—l 

Xdft [k] = Y {oce~^ k ' N ) n 
k -0 


1 - (oee- j2nk / N ) N 
1 - ae~^ k ! N 


1 — a N 

1 - ae~^ k / N 


( 10 . 11 ) 


Finally, the transform pair for the sinusoid says that for a periodic sinusoid x[n] = cos(27r nF) whose digital 
frequency is F = ko/N, the DFT is a pair of impulses at k = ko and k = N — k o- By Euler’s relation, 
x[n] = 0.5e- j27mfe °/ JV + 0.5e _:,27rnfeo / JV and, by periodicity, 0 . 5 e _:,27rl, ' fe o/ Ar = 0.5e- j27rn ^ Ar_fc °^ Jv . Then, with the 
DFT pair 1 <t=> NS[k], and the modulation property, we get the required result. 


REVIEW PANEL 10.10 


The iV-Point DFT of a Sinusoid with Period N and F = ko/N Has Two Nonzero Samples 

cos(2™&)*=* %6[k-ko\ + %6[k-(N-ko)] = {0,...,0, f, 0,...,0, f, 0,..., 0} (DFT) 


k—ko 


k—N—ko 


10.4 Some Practical Guidelines 

From a purely mathematical or computational standpoint, the DFT simply tells us how to transform a set 
of N numbers into another set of N numbers. Its physical significance (what the numbers mean), however, 
stems from its ties to the spectra of both analog and discrete signals. In general, the DFT is only an 
approximation to the actual (Fourier series or transform) spectrum of the underlying analog signal. The 
DFT spectral spacing and DFT magnitude is affected by the choice of sampling rate and how the sample 
values are chosen. The DFT phase is affected by the location of sampling instants. The DFT spectral 
spacing is affected by the sampling duration. Here are some practical guidelines on how to obtain samples 
of an analog signal x(t) for spectrum analysis and interpret the DFT (or DFS) results. 

Choice of sampling instants: The defining relation for the DFT (or DFS) mandates that samples of x[n] 
be chosen over the range 0 < n < N — 1 (through periodic extension, if necessary). Otherwise, the DFT (or 
DFS) phase will not match the expected phase. 

Choice of samples: If a sampling instant corresponds to a jump discontinuity, the sample value should be 
chosen as the midpoint of the discontinuity. The reason is that the Fourier series (or transform) converges 
to the midpoint of any discontinuity. 

Choice of frequency axis: The computation of the DFT (or DFS) is independent of the sampling frequency 
S or sampling interval t s = 1/S. However, if an analog signal is sampled at a sampling rate S, its spectrum 
is periodic with period S. The DFT spectrum describes one period ( N samples) of this spectrum starting 
at the origin. For sampled signals, it is useful to plot the DFT (or DFS) magnitude and phase against the 
analog frequency f = kS/N Hz, k = 0,1,..., N — 1 (with spacing S/N ). For discrete-time signals, we can 
plot the DFT against the digital frequency F = k/N, k = 0,1,..., N — 1 (with spacing 1 /IV). These choices 
are illustrated in Figure 10.3. 
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Choice of frequency range: To compare the DFT results with conventional two-sided spectra, just 
remember that by periodicity, a negative frequency —fo (at the index —ko) in the two-sided spectrum 
corresponds to the frequency S — fo (at the index N — ko) in the (one-sided) DFT spectrum. 

Identifying the highest frequency: The highest frequency in the DFT spectrum corresponds to the 
folding index k = 0.51V and equals F = 0.5 for discrete signals or f = 0.55 Hz for sampled analog signals. 
This highest frequency is also called the folding frequency. For purposes of comparison, its is sufficient to 
plot the DFT spectra only over 0 < k < 0.5A (or 0 < F < 0.5 for discrete-time signals or 0 < / < 0.55 Hz 
for sampled analog signals). 


DFT samples may be plotted against the index or against frequency 


~/h 


— 1 -a- k (Index) 

N -1 


0 


0 


—' - 1 -*—/A 

fo Vo 3 //“ 


—■- ' -■—/A 

1 IN 2/N 3 IN 1 ' 


Two more options are: 


- 1 - 1 -»/ (Hz) Analog frequency 

— 1 (Ad/A f Digital fret i uenc y 

co = 27t/ (analog radian frequency) 

SI = 271 F (digital radian frequency) 


fo = S/N 
F = f/S 


Figure 10.3 Various ways of plotting the DFT 

Plotting reordered spectra: The DFT (or DFS) may also be plotted as two-sided spectra to reveal 
conjugate symmetry about the origin by creating its periodic extension. This is equivalent to creating a 
reordered spectrum by relocating the DFT samples at indices past the folding index k = 0.5A to the left of 
the origin (because X[—k] = X[N — k]). This process is illustrated in Figure 10.4. 



Figure 10.4 Plotting the DFT or its reordered samples 


REVIEW PANEL 10.11 

Practical Guidelines for Sampling a Signal and Interpreting the DFT Results 

Sampling: Start at t = 0. Choose the midpoint value at jumps. Sample above the Nyquist rate. 
Plotting: Plot DFT against index k = 0,1,..., N — 1 or F = or f = kjj Hz. 

Frequency spacing of DFT samples: A/ = S/N Hz (analog) or A F = 1/A (digital frequency). 
Highest frequency: This equals F = 0.5 or / = 0.55 corresponding to the index k = 

For long sequences: The DFT magnitude/phase are usually plotted as continuous functions. 
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10.5 Approximating the DTFT by the DFT 

The DTFT relation and its inverse are 

OO 

X P (F) = J2 #- j2 ™ F 

71 — — OO 

where X p (F) is periodic with unit period. If x\n\ is a finite ./V-point sequence with n = 0,1,..., N — 1, we 
obtain N samples of the DTFT over one period at intervals of 1/N as 

N—l 

Xdft [k] = Y x[n]e~ j2 ™ k/N , k = 0,1,..., N - 1 (10.13) 

n =0 

This describes the discrete Fourier transform (DFT) of x[n] as a sampled version of its DTFT evaluated 
at the frequencies F = k/N, k = 0,1,N — 1. The DFT spectrum thus corresponds to the frequency 
range 0 < F < 1 and is plotted at the frequencies F = k/N, k = 0,1,..., N — 1. 

To recover the finite sequence x[n] from N samples of Xdft[&], we use dF « 1/N and F —> k/N to 
approximate the integral expression in the inversion relation by 

i 

x[n\ = - Y XnFT[k]e j2 ™ k / N , n = 0,1,..., N - 1 (10.14) 

k —0 

This is the inverse discrete Fourier transform (IDFT). The periodicity of the IDFT implies that x [n] 
actually corresponds to one period of a periodic signal. 

If x[n] is a finite ./V-point signal with n = 0,l,...,lV — 1, the DFT is an exact match to its DTFT X P (F) 
at F = k/N, k — 0,1,..., N — 1, and the IDFT results in perfect recovery of x[n]. 

If x[n] is not time-limited, its ./V-point DFT is only an approximation to its DTFT X p (F) evaluated at 
F = k/N, k = 0,1,..., N — 1. Due to implied periodicity, the DFT, in fact, exactly matches the DTFT of 
the periodic extension of x[n\ with period N at these frequencies. 

If x[n] is a discrete periodic signal with period N, its scaled DFT (-^Xdft[&]) is an exact match to the 
impulse strengths in its DTFT X p (F) at F = k/N, k = 0,1,..., N — 1. In this case also, the IDFT results 
in perfect recovery of one period of x[n\ over 0 < n < N — 1. 


J X p (F)e j2 ™ F dF 


( 10 . 12 ) 


REVIEW PANEL 10.12 

The DFT AnFT[fc] of an IV-Sample Sequence x[n] Is an Exact Match to Its Sampled DTFT 

If x[n] is also periodic, the scaled DFT iX DFT [l] is an exact match to its sampled DTFT. 


EXAMPLE 10.4 (Relating the DFT and the DTFT) 

(a) Let x[n\ = {1, 2, 1, 0}. If we use the DTFT, we first find 

X p (F) = 1 + 2e~ j27lF + e~ jA7lF + 0 = [2 + 2cos(27rF)] e - j27rF 
With N = 4, we have F = k/ 4, k = 0,1, 2,3. We then obtain the DFT as 

A DFT [fc] = [2 + 2cos(27rfc/4)]e-^ fe / 4 , A = 0,1,2,3, or X UFT [k\ = {4, -j2, 0, j2} 

Since x[n\ is a finite sequence, the DFT and DTFT show an exact match at F = k/N, k = 0,1, 2,3. 
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With TV = 4, and e 3 2 * nk / N = e ■ 5 " fe7r / 2 , we compute the IDFT of -Xdft[&] = {4, —j 2, 0, j 2} to give 

3 


n = 0: x[0] 

n = 1: x[l] 

n = 2: ar[2] 

n = 3: a; [3] 
The IDFT is thus {1, 


2 , 


0.25^X DF T[fc]e° = 0.25(4 — j2 + 0 +j2) = 1 

k =0 
3 

0.25 X DFT [k}e~ jk7r/2 = 0.25(4 - j2e~ jv/2 + 0 + j2e~ j3w/2 ) = 2 
k =0 
3 


0.25 ^DFT [k]e~ jk7r = 0.25(4 - j2e~ jn + 0 + j2e~ j3 *) = 1 

k—0 

3 

0.25 -^DFT [k]e~ j3kn/2 = 0.25(4 - j2e~ j37r/2 + 0 + e ~ j9n/2 ) = 0 

k =0 

1, 0}, and recovers x[n] exactly. 


(b) Let x[n] = a n u[n\. Its DTFT is X p (F) = 1 _ ae 1 - j27TF . Sampling X p {F) at intervals F = k/N gives 

X P {F)\ . = 


I F=k/N ]_ _ ae -j2irk/N 

The N- point DFT of x[n\ is 

“”(" = 0.1 . 

Clearly, the TV-sample DFT of x[n] does not match the DTFT of x[n\ (unless N — > oo). 

Comment: What does match, however, is the DFT of the TV-sample periodic extension x pe [n] and the 
DTFT of x[n}. We obtain one period of the periodic extension by wrapping around TV-sample sections 
of x[n] = a ” and adding them to give 

m n 1 

x pe [n] = a n + a n+N + a n+2N H- = a n {l+ot N + a 2N + •••) = -- ^ = -- i^x[n} 

1 — a iv 1 — cr v 

1 


Its DFT is thus 


1 - ae~i 2nk / N 


and matches the DTFT of x[n] at F = X. k = 0,1,..., TV — 1. 


10.6 The DFT of Periodic Signals and the DFS 


The Fourier series relations for a periodic signal x p (t) are 


OO 

x p {t)= X[k\e j2nkfot 

k=— oo 



(10.15) 


If we acquire x[n], n = 0,l,...,TV — lasTV samples of x p [t) over one period using a sampling rate of S Hz 
(corresponding to a sampling interval of t s ) and approximate the integral expression for X[k\ by a summation 
using dt —> t s , t —> nt s , T = Nt s , and fo = ^ we obtain 

1 JV-l 1 JV-l 

X DFS [k] = — ^ x[n\e- j2 * kfon H s = -£ x[n\e~i 2 ™ k / N , k = 0,1,,.., TV - 1 (10.16) 

s n—0 n—0 
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The quantity Adfs[^] defines the discrete Fourier series (DFS) as an approximation to the Fourier series 
coefficients of a periodic signal and equals N times the DFT. 


10.6.1 The Inverse DFS 

To recover x\n] from one period of Adfs[^]. we use the Fourier series reconstruction relation whose summation 
index covers one period (from k = 0 to k = N — 1) to obtain 


X 1 N -1 

x[n) = J2 A'dfs [n}e^ kf ° nt ’ = ^ X DFS [fc]e j2 ™ fe/JV , n = 0, 1 , 2 , ... ,N - 1 (10.17) 

k =0 k =0 


This relation describes the inverse discrete Fourier series (IDFS). The sampling interval t s does not 
enter into the computation of the DFS or its inverse. Except for a scale factor, the DFS and DFT relations 
are identical. 


10.6.2 Understanding the DFS Results 

The Xdfs [k] describes the spectrum of a sampled signal and is thus periodic with period 5 (starting at the 
origin). Its N samples are spaced S/N Hz apart and plotted at the frequencies / = kS/N , k = 0, 1,..., N—l. 
However, the highest frequency we can identify in the DFS spectrum is 0.55' (corresponding to the folding 
index k = 0.5 N). 

The iV-sample DFS Adfs[^] = yfADFT[fc] shows an exact match to the Fourier series coefficients X[k] 
of a periodic signal x(t) only if all of the following conditions are satisfied: 

1. The signal samples must be acquired from x(t) starting at t = 0 (using the periodic extension of the 
signal, if necessary). Otherwise, the phase of the DFS coefficients will not match the phase of the 
corresponding Fourier series coefficients. 

2. The periodic signal must contain a finite number of sinusoids (to ensure a band-limited signal with a 
finite highest frequency) and be sampled above the Nyquist rate. Otherwise, there will be aliasing, 
whose effects become more pronounced near the folding frequency 0.55. If the periodic signal is not 
band-limited (contains an infinite number of harmonics), we cannot sample at a rate high enough to 
prevent aliasing. For a pure sinusoid, the Nyquist rate corresponds to two samples per period. 

3. The signal x(t ) must be sampled for an integer number of periods (to ensure a match between the 
periodic extension of x(t) and the implied periodic extension of the sampled signal). Otherwise, the 
periodic extension of its samples will not match that of x(t), and the DFS samples will describe the 
Fourier series coefficients of a different periodic signal whose harmonic frequencies do not match those 
of x(t). This phenomenon is called leakage and results in nonzero spectral components at frequencies 
other than the harmonic frequencies of the original signal x(t). 

If we sample a periodic signal for an integer number of periods, the DFS (or DFT) also preserves the effects 
of symmetry. The DFS of an even symmetric signal is real, the DFS of an odd symmetric signal is imaginary, 
and the DFS of a half-wave symmetric signal is zero at even values of the index k. 
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REVIEW PANEL 10.13 

The DFT of a Sampled Periodic Signal x(t) Is Related to Its Fourier Series Coefficients 

If x(t) is band-limited and sampled for an integer number of periods, the DFT is an exact match to the 
Fourier series coefficients A[fc], with = NX[k], 

If x(t) is not band-limited, there is aliasing. 

If x(t) is not sampled for an integer number of periods, there is also leakage. 


10.6.3 The DFS and DFT of Sinusoids 

Consider the sinusoid x(t) = cos(2tt + 9) whose Fourier series coefficients we know to be O.5Z0 = 0.5e’ e 
at / = fo and 0.5Z — 9 = 0.5e _ A at / = — fo- If x(t) is sampled at the rate S, starting at t = 0, the 
sampled signal is x[n] = cos(27 xnF + 9), where F = fo/S is the digital frequency. As long as F is a rational 
fraction of the form F = ko/N, we obtain N samples of x[n] from ko full periods of x(t). In this case, there 
is no leakage, and the TV-point DFS will match the expected results and show only two nonzero DFS values, 
ADFs[fco] = O.5e J0 and Adfs[A r — ko] = 0.5e _jS . The DFT is obtained by multiplying the DFS by N. 

cos(27rn^ + 9) <=> {0,..., 0, OAe^, 0,..., 0, OJhT^j. 0,..., 0} (DFS) (10.18) 

k—ko k—N—ko 

For the index fc 0 to lie in the range 0 < fco < TV—1, we must ensure that 0 < F < 1 (rather than the customary 
—0.5 < F < 0.5). The frequency corresponding to k 0 will then be k 0 S/N and will equal f 0 (if S > 2/ 0 ) or its 
alias (if S < 2 fo). The nonzero DFT values will equal Xdft[&o] = 0.5 Ne^ 9 and AdptIA - — ko] = 0.51Ve _jfl . 
These results are straightforward to obtain and can be easily extended, by superposition, to the DFT of a 
combination of sinusoids, sampled over an integer number of periods. 


REVIEW PANEL 10.14 

The V-Point DFT of the Sinusoid x[n] = cos(27m^l + 0) Contains Only Two Nonzero Samples 

cos( 27 rn^ +9) 4=> {0,...,0, fe je , 0,...,0, fe~ je , 0,..., 0} (DFT) 

k—ko k—N—ko 


EXAMPLE 10.5 (The DFT and DFS of Sinusoids) 

(a) The signal x(t) = 4cos(1007rt) is sampled at twice the Nyquist rate for three full periods. Find and 
sketch its DFT. 

The frequency of x(t) is 50 Hz, the Nyquist rate is 100 Hz, and the sampling frequency is S = 200 Hz. 
The digital frequency is F = 50/200 = 1/4 = 3/12 = k/N. This means TV = 12 for three full periods. 
The two nonzero DFT values will appear at k = 3 and k = N — 3 = 9. The nonzero DFT values will 
be A[3] = A[9] = (0.5)(4)(TV) = 24. The signal and its DFT are sketched in Figure E10.5A. 


Cosine sign 

al (3 period 

<N 

II 


/ T \ 




DFT 


24 


24 


11 


Figure E10.5A The signal and DFT for Example 10.5(a) 
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(b) Let x(t) = 4sin(727rf) be sampled at S = 128 Hz. Choose the minimum number of samples necessary 
to prevent leakage and find the DFS and DFT of the sampled signal. 

The frequency of x(t) is 36 Hz, so F = 36/128 = 9/32 = k 0 /N. Thus, N = 32, k 0 = 9, and 
the frequency spacing is S/N = 4 Hz. The DFS components will appear at fco = 9 (36 Hz) and 
N — ko = 23 (92 Hz). The Fourier series coefficients of x(t) are — j2 (at 36 Hz) and j'2 (at —36 Hz). 

The DFS samples will be A DFS [9] = — j2, and A DF g[23] = j2. Since A' DFT [fc] = ?VX DF g[fc], we get 
Adft[9] = — j64, Xd F t[23] = j64, and thus 

Adft[&] = {0,.. -, 0, -j6A 0,..., 0, j64, 0,..., 0} 

k =9 k -23 


(c) Let x(t) = 4sin(727 it) — 6cos(127rf) be sampled at S = 21 Hz. Choose the minimum number of samples 
necessary to prevent leakage and find the DFS and DFT of the sampled signal. 

Clearly, the 36-Hz term will be aliased. The digital frequencies (between 0 and 1) of the two terms are 
F\ = 36/21 = 12/7 => 5/7 = ko/N and F 2 = 6/21 = 2/7. Thus, N = 7 and the frequency spacing is 
S/N = 3 Hz. The DFS components of the first term will be —j2 at k = 5 (15 Hz) and j2 at N — k = 2 
(6 Hz). The DFS components of the second term will be —3 at k = 2 and —3 at k = 5. The DFS 
values will add up at the appropriate indices to give X DFS [5] = — 3 — j 2, A DF g[2] = — 3 + j 2, and 

Adfs [k] = {0, 0, —3 + j2, 0, 0, -3 - j2, 0} X BFT [k] = NX BFS [k] = 7A DFS [fc] 

k —2 k —5 

Note how the 36-Hz component was aliased to 6 Hz (the frequency of the second component). 


(d) The signal x(t) = 1 + 8 sin(807rf)cos(407rf) is sampled at twice the Nyquist rate for two full periods. Is 
leakage present? If not, find the DFS of the sampled signal. 

First, note that x(t) = 1 + 4sin(1207rf) + 4sin(407rf). The frequencies are /i = 60 Hz and / 2 = 20 Hz. 
The Nyquist rate is thus 120 Hz, and hence S = 240 Hz. The digital frequencies are F\ = 60/240 = 1/4 
and F 2 = 20/240 = 1/12. The fundamental frequency is fo = GCD(/i, / 2 ) = 20 Hz. Thus, two 
full periods correspond to 0.1 s or N = 24 samples. There is no leakage because we acquire the 
samples over two full periods. The index k = 0 corresponds to the constant (dc value). To find 
the indices of the other nonzero DFS samples, we compute the digital frequencies (in the form k/N) 
as F\ = 60/240 = 1/4 = 6/24 and F 2 = 20/240 = 1/12 = 2/24. The nonzero DFS samples are 
thus Xdfs[0] = 1, Adfs[6] = —j 2, and Adfs[2] = —j 2, and the conjugates Xdfs[18] = j2 and 
Adfs[22] = j2. Thus, 

X BFS [k} = {0, 0, -j2, 0, 0, 0, -j2, 0,..., 0, J2^, 0, 0, 0,J2^, 0, 0} 

fc=2 k -6 fc=18 k =22 


10.6.4 The DFT and DFS of Sampled Periodic Signals 

For periodic signals that are not band-limited, leakage can be prevented by sampling for an integer number of 
periods, but aliasing is unavoidable for any sampling rate. The aliasing error increases at higher frequencies. 
The effects of aliasing can be minimized (but not eliminated) by choosing a high enough sampling rate. A 
useful rule of thumb is that for the DFT to produce an error of about 5% or less up to the M th harmonic 
frequency /m = Mf 0 , we must choose S > 8/m (corresponding to N > 8 M samples per period). 
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EXAMPLE 10.6 (DFS of Sampled Periodic Signals) 

Consider a square wave x(t) that equals 1 for the first half-period and —1 for the next half-period, as 
illustrated in Figure El0.6. 



Figure E10.6 One period of the square wave periodic signal for Example 10.6 


Its Fourier series coefficients are X[k] = —j2/kn, (k odd). If we require the first four harmonics to be in 
error by no more than about 5%, we choose a sampling rate S = 32/o, where fo is the fundamental frequency. 
This means that we acquire N = 32 samples for one period. The samples and their DFS up to k = 8 are 
listed below, along with the error in the nonzero DFS values compared with the Fourier series coefficients. 


s[n] = {0, 1 , 1 ,..., 1 , 1 , 0 , - 1 , - 1 ,..., - 1 , -1} 


15 samples 


15 samples 


^dfs[A:] = {0, -j0.6346, 0, 0.206, 0, -j0.1169, 0, -j0.0762, 0,...} 

off by 0.3% off by 2.9% off by 8.2% off by 16.3% 

Note how we picked zero as the sample value at the discontinuities. As expected, the DFS coefficients are 
zero for odd k (due to the half-wave symmetry in x(t)) and purely imaginary (due to the odd symmetry in 
x(t)). The error in the nonzero harmonics up to k = 4 is less than 5%. 


10.6.5 The Effects of Leakage 

If we do not sample x(t ) for an integer number of periods, the DFT will show the effects of leakage, with 
nonzero components appearing at frequencies other than ±/o, because the periodic extension of the signal 
with non-integer periods will not match the original signal, as illustrated in Figure 10.5. 



Figure 10.5 Illustrating the concept of leakage 


The DFT results will also show aliasing because the periodic extension of the signal with non-integer 
periods will not, in general, be band-limited. As a result, we must resort to the full force of the defining 
relation to compute the DFT. 
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Suppose we sample the 1-Hz sine x(t) = sin(27rf) at S = 16 Hz. Then, F 0 = 1/16. If we choose N = 8, 
the DFT spectral spacing equals S/N = 2 Hz. In other words, there is no DFT component at 1 Hz, the 
frequency of the sine wave! Where should we expect to see the DFT components? If we express the digital 
frequency F 0 = 1/16 as F 0 = kp/N, we obtain kp = NF 0 = 0.5. Thus, F 0 corresponds to the fractional 
index kp = 0.5, and the largest DFT components should appear at the integer index nearest to kp, at k = 0 
(or dc) and k = 1 (or 2 Hz). In fact, the signal and its DFS are given by 

x[n] = {0, 0.3827, 0.7071, 0.9329, 1, 0.9329, 0.7071, 0.3827} 

Aqfs [k] = { 0.6284, -0.2207, -0.0518, -0.0293, -0.0249, -0.0293, -0.0518, -0.2207 } 

off by 1.3% off by 4% off by 23% off by 61% k=N/ 2 


As expected, the largest components appear at k = 0 and k = 1. Since Adfs[^] is real, the DFS results 
describe an even symmetric signal with nonzero average value. In fact, the periodic extension of the sampled 
signal over half a period actually describes a full-rectified sine with even symmetry and a fundamental 
frequency of 2 Hz (see Figure 10.5). The Fourier series coefficients of this full-rectified sine wave (with unit 
peak value) are given by 

2 

7r(l — 4k 2 ) 

We confirm that Adfs[ 0] and Adfs[ 1] show an error of less than 5%. But Aofs[2], Adfs[ 3], and Adfs[ 4] 
deviate significantly. Since the new periodic signal is no longer band-limited, the sampling rate is not high 
enough, and we have aliasing. The value Adfs[ 3], for example, equals the sum of the Fourier series coefficient 
A[3] and all other Fourier series coefficients A[ll], A[19],... that alias to k = 3. In other words, 

oo 2 °° 1 

A DFS [3] = £ A[3 + 8m] = - £ i_ 4 ( 3 + 8m)2 

771=00 771—00 

Although this sum is not easily amenable to a closed-form solution, it can be computed numerically and 
does in fact approach A DF g[3] = —0.0293 (for a large but finite number of coefficients). 



Minimizing Leakage 

Ideally, we should sample periodic signals over an integer number of periods to prevent leakage. In practice, 
it may not be easy to identify the period of a signal in advance. In such cases, it is best to sample over 
as long a signal duration as possible (to reduce the mismatch between the periodic extension of the analog 
and sampled signal). Sampling for a larger time (duration) not only reduces the effects of leakage but also 
yields a more closely spaced spectrum, and a more accurate estimate of the spectrum of the original signal. 
Another way to reduce leakage is to multiply the signal samples by a window function (as described later). 


REVIEW PANEL 10.15 

The DFT of a Sinusoid at /o Hz Sampled for Non-Integer Periods Shows Leakage 

The largest DFT component appears at the integer index closest to kp = F 0 N = f 0 N/S. 

To minimize leakage: Sample for the longest duration possible or (better still) for integer periods. 
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EXAMPLE 10.7 (The Effects of Leakage) 

The signal x(t) = 2cos(207t t) + 5cos(1007rt) is sampled at intervals of t s = 0.005 s for three different 
durations, 0.1 s, 0.125 s, and 1.125 s. Explain the DFT spectrum for each duration. 


The sampling frequency is 5 = l/t s = 200 Hz. The frequencies in x(t) are /i = 10 Hz and f 2 = 50 Hz. 
The two-sided spectrum of x(t) will show a magnitude of 1 at 10 Hz and 2.5 at 50 Hz. The fundamental 
frequency is 10 Hz, and the common period of x(t) is 0.1 s. We have the following results with reference to 
Figure E10.7, which shows the DFS magnitude (|-Xdft|/-W) up to the folding index (or 100 Hz). 


(a) Length = 0.1s N=20 (b) Length = 0.125 s N=25 (c) Length = 1.125 s N=225 



0 10 50 100 0 10 50 100 0 10 50 100 

Analog frequency / [Hz] Analog frequency / [Hz] Analog frequency / [Hz] 

Figure E10.T DFT results for Example 10.7 


(a) The duration of 0.1 s corresponds to one full period, and N = 20. No leakage is present, and the DFS 
results reveal an exact match to the spectrum of x(t). The nonzero components appear at the integer indices 
ki = NF = Nfi/S = 1 and k 2 = NF 2 = Nf 2 /S = 5 (corresponding to 10 Hz and 50 Hz, respectively). 

(b) The duration of 0.125 s does not correspond to an integer number of periods. The number of samples 
over 0.125 s is N = 25. Leakage is present. The largest components appear at the integer indices closest to 
k-\ = NF = Nfi/S = 1.25 (i.e., k = 1 or 8 Hz) and k 2 = Nf 2 /S = 6.25 (i.e., k = 6 or 48 Hz). 

(c) The duration of 1.125 s does not correspond to an integer number of periods. The number of samples 
over 1.125 s is N = 225. Leakage is present. The largest components appear at the integer indices closest to 
fc-i = NF = Nfi/S = 11.25 (i.e., k = 11 or 9.78 Hz) and k 2 = Nf 2 /S = 56.25 (i.e., k = 56 or 49.78 Hz). 

Comment: The spectra reveal that the longest duration (1.125 s) also produces the smallest leakage. 


10.7 The DFT of Nonperiodic Signals 

The Fourier transform X(f) of a nonperiodic signal x(t) is continuous. To find the DFT, x(t) must be 
sampled over a finite duration (TV samples). The spectrum of a sampled signal over its principal period 
(—0.55, 0.55) corresponds to the spectrum of the analog signal SX(f), provided x(t) is band-limited to 
B < 0.55. In practice, no analog signal is truly band-limited. As a result, if x[n] corresponds to N samples 
of the analog signal x(t), obtained at the sampling rate 5, the DFT Xdft[^'] of x[n] yields essentially the 
Fourier series of its periodic extension, and is only approximately related to X{f) by 

X DFT [fc] « 5X (/)\ f=kS/N , 0 < k < 0.5TV (0 < / < 0.55) (10.19) 


REVIEW PANEL 10.16 

The DFT of a Sampled Aperiodic Signal x(t) Approximates Its Scaled Transform SX(f) 
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To find the DFT of an arbitrary signal with some confidence, we must decide on the number of samples N 
and the sampling rate S, based on both theoretical considerations and practical compromises. For example, 
one way to choose a sampling rate is based on energy considerations. We pick the sampling rate as 2 B Hz, 
where the frequency range up to B Hz contains a significant fraction P of the signal energy. The number of 
samples should cover a large enough duration to include significant signal values. 

10.7.1 Spectral Spacing and Zero-Padding 

Often, the spectral spacing S/N is not small enough to make appropriate visual comparisons with the analog 
spectrum X(f), and we need a denser or interpolated version of the DFT spectrum. To decrease the spectral 
spacing, we must choose a larger number of samples N. This increase in N cannot come about by increasing 
the sampling rate S (which would leave the spectral spacing S/N unchanged), but by increasing the duration 
over which we sample the signal. In other words, to reduce the frequency spacing, we must sample the signal 
for a longer duration at the given sampling rate. However, if the original signal is of finite duration, we can 
still increase N by appending zeros (zero-padding). Appending zeros does not improve accuracy because it 
adds no new signal information. It only decreases the spectral spacing and thus interpolates the DFT at 
a denser set of frequencies. To improve the accuracy of the DFT results, we must increase the number of 
signal samples by sampling the signal for a longer time (and not just zero-padding). 


REVIEW PANEL 10.17 

Signal Zero-Padding Corresponds to an Interpolated Spectrum 

Zero-padding reduces the spectral spacing. It does not improve accuracy of the DFT results. 
To improve accuracy, we need more signal samples (not zeros). 


EXAMPLE 10.8 (DFT of Finite-Duration Signals) 

(a) (Spectral Spacing) A 3-s signal is sampled at S' = 100 Hz. The maximum spectral spacing is to be 
A/ = 0.25 Hz. How many samples are needed for the DFT and FFT? 

If we use the DFT, the number of samples is N = S/A/ = 400. Since the 3-s signal gives only 300 
signal samples, we must add 100 padded zeros. The spectral spacing is S/N = 0.25 Hz as required. 
If we use the FFT, we need Nfft = 512 samples (the next higher power of 2). There are now 212 
padded zeros, and the spectral spacing is S/Nfft = 0.1953 Hz, better (i.e. less) than required. 


(b) Let x(t) = tri(f). Its Fourier transform is X(f) = sinc 2 (/). Let us choose S' = 4 Hz and N = 8. 
To obtain samples of x(t) starting at t = 0, we sample the periodic extension of x(t) as illustrated in 
Figure E10.8B and obtain f s XDFT[fc] to give 

x[n] = {1, 0.75, 0.5, 0.25, 0, 0.25, 0.5, 0.75} 

X(f) ^t s X DFT [k] = {1, 0.4268, 0, 0.0732, 0, 0.0732,0,0.4268} 

off by 5.3% off by 62.6% k=N/2 

Since highest frequency present in the DFT spectrum is 0.5S = 2 Hz, the DFT results are listed only 
up to k = 4. Since the frequency spacing is S/N = 0.5 Hz, we compare f s XDFT[&] with X(kS/N) = 
sinc 2 (0.5fc). At k = 0 (dc) and k = 2 (1 Hz), we see a perfect match. At k = 1 (0.5 Hz), f s XDFT[fc] is 
in error by about 5.3%, but at k = 3 (1.5 Hz), the error is a whopping 62.6%. 
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x(t) = trip) 



x(t) =tri(f) x(t) = tri(f) 




Figure E10.8B The triangular pulse signal for Example 10.8(b) 


• (Reducing Spectral Spacing) Let us decrease the spectral spacing by zero-padding to increase 
the number of samples to N = 16. We must sample the periodic extension of the zero-padded 
signal, as shown in Figure E10.8B, to give 


x[n] = {1, 0.75, 0.5, 0.25, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.25, 0.5, 0.75} 

8 zeros 

Note how the padded zeros appear in the middle. Since highest frequency present in the DFT 
spectrum is 2 Hz, the DFT results are listed only up to the folding index k = 8. 

t s X DFT [k] = {1,, .0.8211, 0.4268, 0.1012,0,0.0452, 0.0732, 0.0325, 0, ...} 

off by 5.3% off by 62.6% k=N/2 

The frequency separation is reduced to S/N = 0.25 Hz. Compared with X(kfo) = sinc 2 (0.25fc), 
the DFT results for k = 2 (0.5 Hz) and k = 6 (1.5 Hz) are still off by 5.3% and 62.6%, respectively. 
In other words, zero-padding reduces the spectral spacing, but the DFT results are no more 
accurate. To improve the accuracy, we must pick more signal samples. 

• (Improving Accuracy) If we choose S' = 8 Hz and N = 16, we obtain 16 samples shown in 
Figure E16.8B. We list the 16-sample DFT up to k = 8 (corresponding to the highest frequency 
of 4 Hz present in the DFT): 


t s X DFT [k] = {1, 0.4105, 0, 0.0506, 0, 0.0226, 0, 0.0162, 0, ...} 

off by 1.3% off by 12.4% off by 39.4% off by 96.4% k=N/ 2 

The DFT spectral spacing is still S/N = 0.5 Hz. In comparison with X(k/ 2) = sinc 2 (0.5fc), the 
error in the DFT results for the 0.5-Hz component (fc = 1) and the 1.5-Hz component (fc = 3) 
is now only about 1.3% and 12.4%, respectively. In other words, increasing the number of signal 
samples improves the accuracy of the DFT results. However, the error at 2.5 Hz (k = 5) and 
3.5 Hz (k = 7) is 39.4% and 96.4%, respectively, and implies that the effects of aliasing are more 
predominant at frequencies closer to the folding frequency. 


(c) Consider the signal x(t) = e _t u(t) whose Fourier transform is X(f) = 1/(1 + j2nf). Since the energy 
E in x(t) equals 1, we use Parseval’s relation to estimate the bandwidth B that contains the fraction 
P of this energy as 



1 

1 + 4-7T 2 / 2 


df = P 


tan(0.57rP) 

L) = - 

27r 
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1. If we choose B to contain 95% of the signal energy (P = 0.95), we find B = 12.71/2-7T = 2.02 Hz. 
Then, S > 4.04 Hz. Let us choose S = 5 Hz. For a spectral spacing of 1 Hz, we have S/N = 1 Hz 
and A = 5. So, we sample x(t) at intervals of t s = 1/S = 0.2 s, starting at t = 0, to obtain x[n}. 
Since x(t) is discontinuous at t = 0, we pick cc[0] = 0.5, not 1. The DFT results based on this set 
of choices will not be very good because with A = 5 we sample only a 1-s segment of x(t). 

2. A better choice is IV = 15, a 3-s duration over which x(t ) decays to 0.05. A more practical choice is 
A = 16 (a power of 2, which allows efficient computation of the DFT, using the FFT algorithm). 
This gives a spectral spacing of S/N = 5/16 Hz. Our rule of thumb (A > 8 M) suggests that 
with N = 16, the DFT values Adft[ 1] and Adft[ 2] should show an error of only about 5%. We 
see that t s A' DF T[fc] does compare well with X(f) (see Figure E10.8C), even though the effects of 
aliasing are still evident. 


(a) tx N=16 1=0.2 (b) tX Afcl28 t =0.04 (c) tX N= 50 t =0.2 

s DFT s s DFT s s DFT s 



0 12 0 1 2 0 1 2 


Frequency / [Hz] Frequency / [Hz] Frequency / [Hz] 

Figure E10.8C DFT results for Example 10.8(c) 

3. To improve the results (and minimize aliasing), we must increase S. For example, if we require 
the highest frequency based on 99% of the signal energy, we obtain B = 63.6567/27T = 10.13 Hz. 
Based on this, let us choose S' = 25 Hz. If we sample x(t) over 5 s (by which time it decays to 
less that 0.01), we compute N = (25)(5) = 125. Choosing N = 128 (the next higher power of 2), 
we find that the 128-point DFT result f s ADFT[fc] is almost identical to the true spectrum X(f). 

4. What would happen if we choose S = 5 Hz and five signal samples, but reduce the spectral spacing 
by zero-padding to give N = 50? The 50-point DFT clearly shows the effects of truncation (as 
wiggles) and is a poor match to the true spectrum. This confirms that improved accuracy does 
not come by zero-padding but by including more signal samples. 


10.8 Spectral Smoothing by Time Windows 

Sampling an analog signal for a finite number of samples N is equivalent to multiplying the samples by a 
rectangular A-point window. Due to abrupt truncation of this rectangular window, the spectrum of the 
windowed signal shows a mainlobe and sidelobes that do not decay rapidly enough. This phenomenon is 
similar to the Gibbs effect, which arises during the reconstruction of periodic signals from a finite number of 
harmonics (an abrupt truncation of its spectrum). Just as Fourier series reconstruction uses tapered spectral 
windows to smooth the time signal, the DFT uses tapered time-domain windows to smooth the spectrum, 
but at the expense of making it broader. This is another manifestation of leakage in that the spectral energy 
is distributed (leaked) over a wider frequency range. 

Unlike windows for Fourier series smoothing, we are not constrained by odd-length windows. As shown 
in Figure 10.6, an A-point DFT window is actually generated from a symmetric (A + l)-point window 
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(sampled over N intervals and symmetric about its midpoint) with its last sample discarded (in keeping 
with the implied periodicity of the signal and the window itself). To apply a window, we position it over the 
signal samples and create their pointwise product. 


Bartlett window 

\ N = 12 N = 9 


12 intervals 






9 intervals 


-&H 


No sample here 


Figure 10.6 Features of a DFT window 


10.8.1 Performance Characteristics of Windows 

The spectrum of all windows shows a mainlobe and decaying sidelobes, as illustrated in Figure 10.7. Measures 
of magnitude are often normalized by the peak magnitude P and expressed in decibels (dB) (as a gain or 
attenuation). These measures include the peak value P, the peak sidelobe level, the 3-dB level and the 6-dB 
level, and the high-frequency decay rate (in dB/decade or dB/octave). Measures of spectral width include 
the 3-dB width W 3 , 6-dB width Wq, the width Ws to reach the peak sidelobe level (PSL), and the mainlobe 
width Wm■ These measures are illustrated in Figure 10.7. 



Figure 10.7 DFT spectrum of a typical window 

Other measures of window performance include the coherent gain (CG), equivalent noise bandwidth 
(ENBW), and the scallop loss (SL). For an IV-point window w[n\, these measures are defined by 


JV-l 


N-l 


N H fc ]i 2 


cg ^Ei# ] i 


ENBW = 


k—0 


k=0 


N-l 




k—0 


SL = 20 log 


N-l 




—jnk/N 


k =0 


N-l 


dB (10.20) 


^ w[k] 


k =0 


The reciprocal of the equivalent noise bandwidth is also called the processing gain. The larger the pro¬ 
cessing gain, the easier it is to reliably detect a signal in the presence of noise. 
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As we increase the window length, the mainlobe width of all windows decreases, but the peak sidelobe 
level remains more or less constant. Ideally, for a given window length, the spectrum of a window should 
approach an impulse with as narrow (and tall) a mainlobe as possible, and as small a peak sidelobe level as 
possible. The aim is to pack as much energy in a narrow mainlobe as possible and make the sidelobe level 
as small as possible. These are conflicting requirements in that a narrow mainlobe width also translates 
to a higher peak sidelobe level. Some DFT windows and their spectral characteristics are illustrated in 
Figure 10.8, and summarized in Table 10.4. 

REVIEW PANEL 10.18 

A Window Should Maximize the Mainlobe Energy and Minimize the Sidelobe Energy 

A narrow mainlobe and small sidelobe are conflicting requirements for the spectrum of a window. 


Table 10.4 Some Commonly Used IV-Point DFT Windows 


Entry 

Window 

Expression for w[n) 

W m = # 

Normalized Peak Sidelobe 

1 

Boxcar 

1 

2/A 

0.2172 « -13.3 dB 

2 

Bartlett 

i m 

L N 

4/A 

0.0472 « -26.5 dB 

3 

von Hann 

0.5 + 0.5cos(^) 

4/A 

0.0267 « -31.5 dB 

4 

Hamming 

0.54 +0.46 cos(^) 

4/A 

0.0073 « -42.7 dB 

5 

Blackman 

0.42 + 0.5cos(^) + 0.08cos(^) 

6/A 

0.0012 « -58.1 dB 

6 

Kaiser 

/o(tt/V 1 - (2fc/A) 2 ) 

/ 0 (tt/3) 

Vi+z 32 

N 

*!(,«) " " 45J dB (f ° r 13 - 2) 

NOTES: k = 0.5A — n, where n = 0,1,..., A — 1. Wm is the mainlobe width. 

For the Kaiser window, / 0 (.) is the modified Bessel function of order zero. 

For the Kaiser window, the parameter (3 controls the peak sidelobe level. 

The von Hann window is also known as the Hanning window. 


10.8.2 The Spectrum of Windowed Sinusoids 

Consider the signal x[n] = cos(27 rnF 0 ), F 0 = k 0 /M. Its DTFT is X p (F) = 0.5 6(F — F 0 ) + 0.5 6(F + F 0 ). If 
this sinusoid is windowed by an A-point window w [n] whose spectrum is W(F ), the DTFT of the windowed 
signal is given by the periodic convolution 


X W (F) = X P (F)®W(F ) = 0.5 W(F - F 0 ) + 0.5 W(F + F 0 ) (10.21) 


The window thus smears out the true spectrum. To obtain a windowed signal that is a replica of the 
spectrum of the sinusoid, we require W(F) = 6 (F), which corresponds to the impractical infinite-length 
time window. The more the spectrum W(F) of an A-point window resembles an impulse, the better the 
windowed spectrum matches the original. 

The A-point DFT of the signal x[n] may be regarded as the DTFT of the product of the infinite-length 
x[n\ and an A-point rectangular window, evaluated at F = k/N , k = 0,1,..., A — 1. Since spectrum of the 
A-point rectangular window is W(F) = A sl "^^f , the DTFT spectrum of the windowed signal is 


X W (F) = 0.5 A 


sinc[A(F — F 0 )) 
sinc(E — F 0 ) 


sinc(F + Fq) 


( 10 . 22 ) 
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Bartlett window: N= 20 



Index n 

von Hann window: N= 20 



Index n 

Hamming window: N =20 



Index n 

Blackman window: N =20 



Index n 

Kaiser window: N =20 p = 2 



Index n 



0 0.1 0.2 0.3 0.4 0.5 

Digital frequency F 



_80 i__u_in_u_ h_11_ m _l- _i 

0 0.1 0.2 0.3 0.4 0.5 


Digital frequency F 



■80 1 - 1 -- 1 -^- 1 

0 0.1 0.2 0.3 0.4 0.5 


Digital frequency F 



.go I_ I _U_ I _11_Ui_ w M ~ ■ 

0 0.1 0.2 0.3 0.4 0.5 


Digital frequency F 



.go I _I_ Li-11 _ li-Jii _w M ^_ I 

0 0.1 0.2 0.3 0.4 0.5 


Digital frequency F 


Figure 10.8 Commonly used DFT windows and their spectral characteristics 
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The i\ 7 -point DFT of the windowed sinusoid is given by ADFT[fc] = X w (F)\ F=k / N . If the DFT length N 
equals M, the number of samples over fc 0 full periods of x[n \, we see that sinc[N(F — F 0 )] = sincffc — ko), 
and this equals zero, unless k — ko. Similarly, sinc[A r (F 1 + Fq)] = sinc(fc + ko) is nonzero only if k — — ko■ 
The DFT thus contains only two nonzero terms and equals 


Adft [k] = X W (F) 


F=k/N 


0.5 NS[k - ko] + 0.5 N5[k - k 0 ] (if N = M) 


(10.23) 


In other words, using an N -point rectangular window that covers an integer number of periods (M samples) 
of a sinusoid (i.e., with M = N) gives us exact results. The reason of course is that the DTFT sampling 
instants fall on the nulls of the sine spectrum. If the window length N does not equal M (an integer number 
of periods), the sampling instants will fall between the nulls, and since the sidelobes of the sine function are 
large, the DFT results will show considerable leakage. To reduce the effects of leakage, we must use windows 
whose spectrum shows small sidelobe levels. 


10.8.3 Resolution 

Windows are often used to reduce the effects of leakage and improve resolution. Frequency resolution refers 
to our ability to clearly distinguish between two closely spaced sinusoids of similar amplitudes. Dynamic- 
range resolution refers to our ability to resolve large differences in signal amplitudes. The spectrum of all 
windows reveals a mainlobe and smaller sidelobes. It smears out the true spectrum and makes components 
separated by less than the mainlobe width indistinguishable. The rectangular window yields the best fre¬ 
quency resolution for a given length N since it has the smallest mainlobe. However, it also has the largest 
peak sidelobe level of any window. This leads to significant leakage and the worst dynamic-range resolution 
because small amplitude signals can get masked by the sidelobes of the window. 

Tapered windows with less abrupt truncation show reduced sidelobe levels and lead to reduced leakage 
and improved dynamic-range resolution. They also show increased mainlobe widths Wm, leading to poorer 
frequency resolution. The choice of a window is based on a compromise between the two conflicting re¬ 
quirements of minimizing the mainlobe width (improving frequency resolution) and minimizing the sidelobe 
magnitude (improving dynamic-range resolution). 


REVIEW PANEL 10.19 

Good Frequency Resolution and Dynamic-Range Resolution Are Conflicting Requirements 

To improve frequency resolution, use windows with narrow mainlobes. 

To improve dynamic-range resolution, use windows with small sidelobes. 

The mainlobe width of all windows decreases as we increase the window length. However, the peak 
sidelobe level remains more or less constant. To achieve a frequency resolution of A/, the digital frequency 
A F = A f/S must equal or exceed the mainlobe width Wm of the window. This yields the window length N. 
For a given window to achieve the same frequency resolution as the rectangular window, we require a larger 
window length (a smaller mainlobe width) and hence a larger signal length. The increase in signal length 
must come by choosing more signal samples (and not by zero-padding). To achieve a given dynamic-range 
resolution, however, we must select a window with small sidelobes, regardless of the window length. 


REVIEW PANEL 10.20 

The Smallest Frequency We Can Resolve Depends on the Mainlobe Width of the Window 

To resolve frequencies separated by A/, we require ^f- = Wm = % (window mainlobe width). 

K depends on the window. To decrease A/, increase N (more signal samples, not zero-padding). 
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EXAMPLE 10.9 (Frequency Resolution) 

The signal x(t) = A\ cos(27t f 0 t) + A 2 cos[27r(/ 0 + A f)t\, where A\ = A 2 = 1, fo = 30 Hz is sampled at the 
rate S = 128 Hz. We acquire N samples, zero-pad them to length Afft, an< l obtain the ApFT-point FFT. 

1. What is the smallest A/ that can be resolved for 

N = 256, Afft = 2048 using a rectangular and von Hann (Hanning) window. 

N = 512, Nfft = 2048 using a rectangular and von Hann window. 

N = 256, Afft = 4096 using a rectangular and von Hann window. 

2. How do the results change if A 2 = 0.05? 

(a) (Frequency Resolution) Since A F = A f/S = Wm, we have A/ = SWm- We compute: 

Rectangular window: A/ = SWm = 2S/N = 1 Hz for N = 256 and 0.5 Hz for N = 512 

von Hann window: A/ = SWm — 4 S/N = 2 Hz for N = 256 and 1 Hz for N = 512 

Note that Afft governs only the FFT spacing S'/Afft, whereas N governs only the frequency resolu¬ 
tion S/N (which does not depend on the zero-padded length). Figure E10.9A shows the FFT spectra, 
plotted as continuous curves, over a selected frequency range. We make the following remarks: 


1. For a given signal length N , the rectangular window resolves a smaller A/ but also has the largest 
sidelobes (panels a and b). This means that the effects of leakage are more severe for a rectangular 
window than for any other. 

2. We can resolve a smaller A/ by increasing the signal length N alone (panel c). To resolve the 
same A/ with a von Hann window, we must double the signal length N (panel d). This means that 
we can improve resolution only by increasing the number of signal samples (adding more signal 
information). How many more signal samples we require will depend on the desired resolution 
and the type of window used. 

3. We cannot resolve a smaller A/ by increasing the zero-padded length TVfft alone (panels e and 
f). This means that increasing the number of samples by zero-padding cannot improve resolution. 
Zero-padding simply interpolates the DFT at a denser set of frequencies. It simply cannot improve 
the accuracy of the DFT results because adding more zeros does not add more signal information. 


(a) N =256 NFFT=2048 No window 


(b) N =256 NFFT=2048 von Hann window 
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(c) iV=512 NFFT=2048 No window (d) N= 512 NFFT=2048 von Hann window 



28 29 30 31 32 36 26 28 29 30 31 32 36 

Analog frequency / [Hz] Analog frequency / [Flz] 


(e) N =256 NFFT=4096 No window (f) N =256 NFFT=4096 von Hann window 



26 28 29 30 31 32 36 26 28 29 30 31 32 36 

Analog frequency / [Hz] Analog frequency / [Hz] 

Figure E10.9A DFT spectra for Example 10.9(a) 


(b) (Dynamic-Range Resolution) If A 2 = 0.05 (26 dB below A\), the large sidelobes of the rectangular 
window (13 dB below the peak) will mask the second peak at 31 Hz, even if we increase N and jVfft- 
This is illustrated in Figure E10.9B(a) (where the peak magnitude is normalized to unity, or 0 dB) for 
N = 512 and JVfft = 4096. For the same values of N and IVfft, however, the smaller sidelobes of the 
von Hann window (31.5 dB below the peak) do allow us to resolve two distinct peaks in the windowed 
spectrum, as shown in Figure E10.9B(b). 



Analog frequency / [Hz] Analog frequency / [Hz] 

Figure E10.9B DFT spectra for Example 10.9(b) 


10.8.4 Detecting Hidden Periodicity Using the DFT 

Given an analog signal x(t) known to contain periodic components, how do we estimate their frequencies 
and magnitude? There are several ways. Most rely on statistical estimates, especially if the signal x(t) is 
also corrupted by noise. Here is a simpler, perhaps more intuitive—but by no means the best—approach 
based on the effects of aliasing. The location and magnitude of the components in the DFT spectrum can 
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change with the sampling rate if this rate is below the Nyquist rate. Due to aliasing, the spectrum may not 
drop to zero at 0.5S' and may even show increased magnitudes as we move toward the folding frequency. If 
we try to minimize the effects of noise by using a lowpass filter, we must ensure that its cutoff frequency 
exceeds the frequency of all the components of interest present in x(t). We have no a priori way of doing 
this. A better way, if the data can be acquired repeatedly, is to use the average of many runs. Averaging 
minimizes noise while preserving the integrity of the signal. 

A crude estimate of the sampling frequency may be obtained by observing the most rapidly varying 
portions of the signal. Failing this, we choose an arbitrary but small sampling frequency, sample x(t), and 
observe the DFT spectrum. We repeat the process with increasing sampling rates and observe how the DFT 
spectrum changes, and when the spectrum shows little change in the location of its spectral components, 
we have the right spectrum and the right sampling frequency. This trial-and-error method is illustrated in 
Figure 10.9 and actually depends on aliasing for its success. 


(a) DFT spectrum 5=100 Hz 



0 50 100 150 200 250 

Analog frequency / [Hz] 

(c) DFT spectrum 5=200 Hz shows aliasing 



Analog frequency / [Hz] 


(b) DFT spectrum 5=500 Hz 




Wj 

0 50 100 150 200 250 

Analog frequency f [Hz] 

(d) 5=1 kHz No change in spectral locations 

I.A,^vF]iL*Aky 


U/W 


0 50 100 150 200 250 

Analog frequency / [Hz] 


Figure 10.9 Trial-and-error method for obtaining the DFT spectrum 


If x(t) is a sinusoid, its magnitude A is computed from AoFT[fco] = 0.5 NA, where the index ko corresponds 
to the peak in the IV-point DFT. However, if other nonperiodic signals are also present in x(t), this may not 
yield a correct result. A better estimate of the magnitude of the sinusoid may be obtained by comparing 
two DFT results of different lengths—say, Ni = N and N 2 = 21V. The A^-point DFT at the index /q of 
the peak will equal 0.5-/Vp4 plus a contribution due to the nonperiodic signals. Similarly, the A^-point DFT 
will show a peak at k 2 (where k 2 = 2k\ if N 2 = 21Vi), and its value will equal 0.5A^A plus a contribution 
due to the nonperiodic signals. If the nonperiodic components do not affect the spectrum significantly, the 
difference in these two values will cancel out the contribution due to the nonperiodic components, and yield 
an estimate for the magnitude of the sinusoid from 

A D ft 2[fc 2 ] - Adfti [ki] = 0.5N 2 A - O.bN-^A (10.24) 
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EXAMPLE 10.10 (Detecting Hidden Periodicity) 

A signal x(t) is known to contain a sinusoidal component. The 80-point DFT result and a comparison of 
the 80-point and 160-point DFT are shown in Figure E10.10. Estimate the frequency and magnitude of the 
sinusoid and its DFT index. The sampling rate is S = 10 Hz. 

(a) FFT of a signal computed with N = 80 

86.48 

<D 

TD 
3 

t 47.12 

<3 

5 

o 

0 0.05 0.5 0 0.05 0.5 

Digital frequency F Digital frequency F 

Figure E10.10 DFT spectra for Example 10.10 

The comparison of the two DFT results suggests a peak at F = 0.05 and the presence of a sinusoid. 
Since the sampling rate is S = 10 Hz, the frequency of the sinusoid is / = FS = 0.5 Hz. Let N\ = 80 and 
N 2 = 160. The peak in the -ZVi-point DFT occurs at the index k\ = 4 because F = 0.05 = ki/N\ = 4/80. 
Similarly, the peak in the _/V 2 -point DFT occurs at the index k 2 = 8 because F = 0.05 = k 2 /N 2 = 8/160. 
Since the two spectra do not differ much, except near the peak, the difference in the peak values allows us 
to compute the peak value A of the sinusoid from 

A D FT 2 [fc2] - X DFT i[fci] = 86.48 - 47.12 = 0.5 N 2 A - 0.5 N X A = 40A 

Thus, A = 0.984 and implies the presence of the 0.5-Hz sinusoidal component 0.984 cos(7rf + 0). 

Comment: The DFT results shown in Figure E10.10 are actually for the signal x(t) = cos(7rf) + e~\ 
sampled at S = 10 Hz. The sinusoidal component has unit peak value, and the DFT estimate (A = 0.984) 
differs from this value by less than 2%. Choosing larger DFT lengths would improve the accuracy of the 
estimate. However, the 80-point DFT alone yields the estimate A = 47.12/40 = 1.178 (an 18% difference), 
whereas the 160-point DFT alone yields A = 86.48/80 = 1.081 (an 8% difference). 



(b) FFT with JV =80 and AT =160 (light) 



10.9 Applications in Signal Processing 

The applications of the DFT and FFT span a wide variety of disciplines. Here, we briefly describe some 
applications directly related to digital signal processing. 

10.9.1 Convolution of Long Sequences 

A situation that often arises in practice is the processing of a long stream of incoming data by a filter whose 
impulse response is much shorter than that of the incoming data. The convolution of a short sequence 
h[n\ of length N (such as an averaging filter) with a very long sequence x[n] of length L N (such as an 
incoming stream of data) can involve large amounts of computation and memory. There are two preferred 
alternatives, both of which are based on sectioning the long sequence x[n] into shorter ones. The DFT offers 
a useful means of finding such a convolution. It even allows on-line implementation if we can tolerate a small 
processing delay. 
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The Overlap-Add Method 

Suppose h[n\ is of length N, and the length of x[n] is L = mN (if not, we can always zero-pad it to this 
length). We partition x[n] into m segments a;o[n],a;i[n],..., x m _i[n], each of length N. We find the regular 
convolution of each section with h[n\ to give the partial results yo[n],yi [n],..., y m -i[n]. Using superposition, 
the total convolution is the sum of their shifted (by multiples of N ) versions 

y[n] = yo[n\ + y^n - N] + y 2 [n -2N}-\ -b y m -\[n - (m - 1)N] (10.25) 

Since each regular convolution contains 2TV — 1 samples, we zero-pad h[n] and each section Xk[n\ with N — 1 
zeros before finding [n] using the FFT. Splitting x[n\ into equal-length segments is not a strict requirement. 
We may use sections of different lengths, provided we keep track of how much each partial convolution must 
be shifted before adding the results. 

The Overlap-Save Method 

The regular convolution of sequences of length L and N has L + N — 1 samples. If L > N and we zero-pad 
the second sequence to length L, their periodic convolution has 2L — 1 samples. Its first N — 1 samples are 
contaminated by wraparound, and the rest correspond to the regular convolution. To understand this, let 
L = 16 and N = 7. If we pad N by nine zeros, their regular convolution has 31 (or 2L— 1) samples with nine 
trailing zeros {L — N = 9). For periodic convolution, 15 samples {L — 1 = 15) are wrapped around. Since 
the last nine (or L — N ) are zeros, only the first six samples (L — N — ( N — 1) = N — 1 = 6) of the periodic 
convolution are contaminated by wraparound. This idea is the basis for the overlap-save method. First, we 
add N — 1 leading zeros to the longer sequence x[n] and section it into k overlapping (by N — 1) segments of 
length M. Typically, we choose M ss 2 N. Next, we zero-pad h[n] (with trailing zeros) to length M, and find 
the periodic convolution of h[n] with each section of x[n\. Finally, we discard the first N — 1 (contaminated) 
samples from each convolution and glue (concatenate) the results to give the required convolution. 

In either method, the FFT of the shorter sequence need be found only once, stored, and reused for 
all subsequent partial convolutions. Both methods allow on-line implementation if we can tolerate a small 
processing delay that equals the time required for each section of the long sequence to arrive at the proces¬ 
sor (assuming the time taken for finding the partial convolutions is less than this processing delay). The 
correlation of two sequences may also be found in exactly the same manner, using either method, provided 
we use a folded version of one sequence. 


EXAMPLE 10.11 (Overlap-Add and Overlap-Save Methods of Convolution) 

Let x[n] = {1,2,3,3,4, 5} and h[n] = {1,1,1}. Here L = 6 and N = 3. 

(a) To find their convolution using the overlap-add method, we section x[n\ into two sequences given by 
x 0 [n] = {1,2,3} and X\ [n] = {3,4,5}, and obtain the two convolution results: 

yo[n] = x 0 [ri\ * h[n] = {1,3,6,5,3} yi[n] = xi[n]*h[ri\ = {3,7,12,9,5} 


Shifting and superposition results in the required convolution y[n] as 


V M = Vo M + yi[n 



1,3,6,5,3 

3,7,12,9,5 


{1,3,6,8,10,12,9,5} 


This result can be confirmed using any of the convolution algorithms described in the text. 
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(b) To find their convolution using the overlap-add method, we start by creating the zero-padded sequence 
x[n] = {0,0,1,2,3,3,4, 5}. If we choose M = 5, we get three overlapping sections of x[n\ (we need to 
zero-pad the last one) described by 

x o[n] = {0,0,1,2,3} x\[n\ = {2,3,3,4,5} x 2 [n] = {4,5,0,0,0} 

The zero-padded h[n] becomes h[n] = {1,1,1,0,0}. Periodic convolution gives 

xo [n\®h[n] = {5,3,1,3,6} 
xi [n]®h[n] = {11,10,8,10,12} 

x 2 [n\®h[n] = {4, 9, 9,5,0} 

We discard the first two samples from each convolution and glue the results to obtain 

■y[n] = x[?r] * h[n] = {1,3,6,8,10,12,9,5,0} 

Note that the last sample (due to the zero-padding) is redundant, and may be discarded. 


10.9.2 Deconvolution 

Given a signal y[n\ that represents the output of some system with impulse response h[n], how do we recover 
the input x[n ] where y[n] = x[n\-kh[n]7 One method is to undo the effects of convolution using deconvolution. 
The time-domain approach to deconvolution was studied earlier. Here, we examine a frequency-domain 
alternative based on the DFT (or FFT). 

The idea is to transform the convolution relation using the FFT to obtain TpFT[fc] = Afft [k] Hfft [&], 
compute Afft[&] = Tfft [k] /HfftM ^y pointwise division, and then find x[n] as the IFFT of Afft[^']- 
This process does work in many cases, but it has two disadvantages. First, it fails if -J/fft^’] equals zero at 
some index because we get division by zero. Second, it is quite sensitive to noise in the input x[n] and to 
the accuracy with which y[n] is known. 

10.9.3 Band-Limited Signal Interpolation 

Interpolation of x[n ] by M to a new signal xj[n ] is equivalent to a sampling rate increase by M. If the 
signal has been sampled above the Nyquist rate, signal interpolation should add no new information to the 
spectrum. The idea of zero-padding forms the basis for an interpolation method using the DFT in the sense 
that the (TWTV)-sample DFT of the interpolated signal should contain N samples corresponding to the DFT 
of cc[n], while the rest should be zero. Thus, if we find the DFT of x[n], zero-pad it (by inserting zeros about 
the folding index) to increase its length to MTV, and find the inverse DFT of the zero-padded sequence, we 
should obtain the interpolated signal Xi [n]. This approach works well for band-limited signals (such as pure 
sinusoids sampled above the Nyquist rate over an integer number of periods). To implement this process, 
we split the TV-point DFT Adft[^] of x[n] about the folding index A/2. If A is even, the folding index falls 
on the sample value A [A/2], and it must also be split in half. We then insert enough zeros in the middle to 
create a padded sequence X zp [k\ with MN samples. It has the form 

{A[0],..., A [TV/2 - 1], 0 1 _^ 1 _0, A [TV/2 + 1],..., A[TV - 1]} (odd N) 

(M-i)JV zeros 

{A[0],..., 0.5A[TV/2], 0,..., 0, 0.5 A [TV/2],..., A [TV — 1]} (even N) 1 

N(M—i)—i zeros 
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The inverse DFT of X zp [fc] will include the factor 1/MN and its machine computation may show (small) 
imaginary parts. We therefore retain only its real part, and divide by M, to obtain the interpolated signal 
Xi[n], which contains M — 1 interpolated values between each sample of x[n]: 


xi[n ] 


1 

M 


Re 


IDFT{X zp [fc]} 


(10.27) 


This method is entirely equivalent to creating a zero-interpolated signal (which produces spectrum repli¬ 
cation), and filtering the replicated spectrum (by zeroing out the spurious images). For periodic band-limited 
signals sampled above the Nyquist rate for an integer number of periods, the interpolation is exact. For all 
others, imperfections show up as a poor match, especially near the ends, since we are actually interpolating 
to zero outside the signal duration. 


EXAMPLE 10.12 (Signal Interpolation Using the FFT) 

(a) For a sinusoid sampled over one period with four samples, we obtain the signal x[n ] = {0,1,0, — 1}. 
Its DFT is Xdft[&] = {0, —j'2,0, j2}. To interpolate this by M = 8, we generate the 32-sample zero- 
padded sequence Zt = {0, —j'2,0, (27 zeros), 0,j2}. The interpolated sequence (the IDFT of Zt) 
shows an exact match to the sinusoid, as illustrated in Figure E10.12)(a). 


(a) Interpolated sinusoid: 4 samples over one period 



Time t 


(b) Interpolated sinusoid: 4 samples over a half-period 



Figure E10.12 Interpolated sinusoids for Example 10.12 


(b) For a sinusoid sampled over a half-period with four samples, interpolation does not yield exact results, 
as shown in Figure E10.12(b). Since we are actually sampling one period of a full-rectified sine (the 
periodic extension), the signal is not band-limited, and the chosen sampling frequency is too low. This 
shows up as a poor match, especially near the ends of the sequence. 


10.9.4 The Discrete Hilbert Transform 

The Hilbert transform describes an operation that shifts the phase of a signal x(t) by — In the analog 
domain, the phase shift can be achieved by passing x(t) through a filter whose transfer function H(f) is 

tf(/) = -jsgn(/) = { f f >° 0 (10.28) 

In the time domain, the phase-shifted signal x(t ) is given by the convolution 

x(t) = — * x(t) (10.29) 
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The phase-shifted signal x(t) defines the Hilbert transform of x(t). The spectrum X(f) of the Hilbert- 
transformed signal equals the product of X(f) with the transform of 1/irt. In other words, 

X(/) = -jsgn(/)X(/) (10.30) 

A system that shifts the phase of a signal by ±f is called a Hilbert transformer or a quadrature filter. 
Such a system can be used to generate a single-sideband amplitude modulated (SSB AM) signal. 

Unlike most other transforms, the Hilbert transform belongs to the same domain as the signal trans¬ 
formed. Due to the singularity in 1/irt at t = 0, a formal evaluation of this relation requires complex 
variable theory. 

The discrete Hilbert transform of a sequence may be obtained by using the FFT. The Hilbert 
transform of x[n\ involves the convolution of x[n\ with the impulse response h[n] of the Hilbert transformer 
whose spectrum is H(F) = — jsgn(F). The easiest way to perform this convolution is by FFT methods. 
We find the Appoint FFT of x[n] and multiply by the periodic extension (from k = 0 to k — N — 1) of N 
samples of sgn(F), which may be written as 

sgn[fc] = {0, 1,1, ., 1, 0, -1,-1 -1 } (10.31) 

K —2 samples ^-2 samples 

The inverse FFT of the product, multiplied by the omitted factor —j, yields the Hilbert transform. 

10.10 Spectrum Estimation 

The power spectral density (PSD) R xx (f) of an analog power signal or random signal x(t) is the Fourier 
transform of its autocorrelation function r xx {i) and is a real, non-negative, even function with -R xa ;(0) equal 
to the average power in x{t). If a signal x(t) is sampled and available only over a finite duration, the best 
we can do is estimate the PSD of the underlying signal x(t) from the given finite record. This is because the 
spectrum of finite sequences suffers from leakage and poor resolution. The PSD estimate of a noisy analog 
signal x(t) from a finite number of its samples is based on two fundamentally different approaches. The first, 
non-parametric spectrum estimation, makes no assumptions about the data. The second, parametric 
spectrum estimation, models the data as the output of a digital filter excited by a noise input with a 
constant power spectral density, estimates the filter coefficients, and in so doing arrives at an estimate of the 
true PSD. Both rely on statistical measures to establish the quality of the estimate. 

10.10.1 The Periodogram Estimate 

The simplest non-parametric estimate is the periodogram P[k] that is based on the DFT of an A r -sample 
sequence x[n}. It is defined as 

P[k] = ^\X OFT [k]\ 2 (10.32) 

Although P[k\ provides a good estimate for deterministic, band-limited, power signals sampled above the 
Nyquist rate, it yields poor estimates for noisy signals because the quality of the estimate does not improve 
with increasing record length N (even though the spectral spacing decreases). 


EXAMPLE 10.13 (The Concept of the Periodogram) 

The sequence x[n] = {0, 1, 0, —1} is obtained by sampling a sinusoid for one period at twice the Nyquist 
rate. Find its periodogram estimate. 
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The DFT of x[n] is X DFT [k] = {0, -j 2, 0, j 2}. Thus, P[k\ = i|X DFT [fc]| 2 = {0, 1, 0, 1}. 

This is usually plotted as a bar graph with each sample occupying a bin width A F = 1/N = 0.25. 
The total power thus equals A F y P[k] = 0.5, and matches the true power in the sinusoid. 


10.10.2 PSD Estimation by the Welch Method 

The Welch method is based on the concept of averaging the results of overlapping periodogram estimates 
and finds widespread use in spectrum estimation. The iV-sample signal x[n] is sectioned into K overlapping 
M-sample sections XM[n], each with an overlap of D samples. A 50%- 75% overlap is common practice. 
Each section is windowed by an M-point window w[n] to control leakage. The PSD of each windowed section 
is found using the periodogram jj \Xm [fc] | 2 , and the K periodograms are averaged to obtain an M-point 
averaged periodogram. It is customary to normalize (divide) this result by the power in the window 
signal QT) IUdft [k ]| 2 or -A |w[?r]| 2 ). Sections of larger length result in a smaller spectral spacing, whereas 
more sections result in a smoother estimate (at the risk of masking sharp details). The number of sections 
chosen is a trade-off between decreasing the spectral spacing and smoothing the estimate. Averaging the 
results of the (presumably uncorrelated) segments reduces the statistical fluctuations (but at the expense 
of a larger spectral spacing). In the related Bartlett method, the segments are neither overlapped nor 
windowed. Figure 10.10(a) shows the Welch PSD of a 400-point chirp signal, whose digital frequency varies 
from F = 0.2 to F = 0.4, using a 45% overlap and a 64-point von Hann window (shown dark), and a 
rectangular window (no window). Note how the windowing results in significant smoothing. 


(a) Welch PSD of chirp (0.2<F< 0.4) JV=400 
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(b) Tukey PSD of chirp (0.2<F< 0.4) N= 400 
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Figure 10.10 Welch and Tukey PSD of a chirp signal 


10.10.3 PSD Estimation by the Blackman-Tukey Method 

The Blackman-Tukey method relies on finding the PSD from the windowed autocorrelation, which is 
assumed to be zero past the window length. The A-sample signal x[n} is zero-padded to get the 2A’-sample 
signal y[n]. The linear autocorrelation of x[n] equals the periodic autocorrelation of y[n] and is evaluated by 
finding the FFT Yp FT [A:] and taking the IFFT of T FF t [k] U FFT W\ to obtain the 2V-sample autocorrelation 
estimate r xx [n\. This autocorrelation is then windowed by an M-point window (to smooth the spectrum and 
reduce the effects of poor autocorrelation estimates due to the finite data length). The FFT of the M-sample 
windowed autocorrelation yields the smoothed periodogram. Using a smaller M (narrower windows) for 
the autocorrelation provides greater smoothing but may also mask any peaks or obscure the sharp details. 
Typical values of the window length M range from M = 0.1 N to M = 0.5AA Only windows whose transform 
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is entirely positive should be used. Of the few that meet this constraint, the most commonly used is the 
Bartlett (triangular) window. Figure 10.10(b) shows the Tukey PSD of a 1000-point chirp signal, whose 
digital frequency varies from F = 0.2 to F = 0.4, using a 64-point Bartlett window. 

The Welch method is more useful for detecting closely spaced peaks of similar magnitudes (frequency res¬ 
olution). The Blackman-Tukey method is better for detecting well-separated peaks with different magnitudes 
( dynamic-range resolution). Neither is very effective for short data lengths. 


10.10.4 Non-Parametric System Identification 

The Fourier transform R yx (f) of the cross-correlation r yx (t) = y(t) ** x(t) = y(t) * x(—t) of two random 
signals x(t) and y(t) is called the cross-spectral density. For a system with impulse response h(t), the 
input x(t) yields the output y(t) = x(t) * hit), and we have 

r yx (t) = y(t) -kx(-t) = h(t) -kx(t) *x(—t) = h(t) *r xx (t) (10.33) 

The Fourier transform of both sides yields 

Ryx(f) = H(f)R xx (f) H(f) = (10.34) 

-K'xxyj ) 


This relation allows us to identify an unknown transfer function H{f) as the ratio of the cross-spectral 
density R yx (f) and the PSD R xx (f) of the input x(t). If x(t) is a noise signal with a constant power spectral 
density, its PSD is a constant of the form R xx (f) = K. Then, H(f) = R yx (f)/K is directly proportional to 
the cross-spectral density. 



0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 

Digital frequency F 

Figure 10.11 Spectrum of an HR filter and its non-parametric FIR filter estimate 


This approach is termed non-parametric because it presupposes no model for the system. In practice, 
we use the FFT to approximate R xx (f) and R yx (f) (using the Welch method, for example) by the finite 
iV-sample sequences R xx [k) and R yx [k}. As a consequence, the transfer function H[k) = R yx [k]/R xx [k] also 
has N samples and describes an FIR filter. Its inverse FFT yields the TV-sample impulse response h[n\. 
Figure 10.11 shows the spectrum of an HR filter defined by y[n] — 0.5 y[n — 1] = x[n] (or h[n] = (0.5) n u[?r]), 
and its 20-point FIR estimate obtained by using a 400-sample noise sequence and the Welch method. 
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10.10.5 Time-Frequency Plots 

In practical situations, we are often faced with the task of finding how the spectrum of signals varies with 
time. A simple approach is to section the signal into overlapping segments, window each section to reduce 
leakage, and find the PSD (using the Welch method, for example). The PSD for each section is then staggered 
and stacked to generate what is called a waterfall plot or time-frequency plot. Figure 10.12 shows such 
a waterfall plot for the sum of a single frequency sinusoid and a chirp signal whose frequency varies linearly 
with time. It provides a much better visual indication of how the spectrum evolves with time. 


(a) 20 Hz sine + 60-100 Hz chirp signal (b) Its time-frequency (waterfall) plot 
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Figure 10.12 Time-frequency plot for the sum of a sinusoid and a chirp signal 

The fundamental restriction in obtaining the time-frequency information, especially for short time records, 
is that we cannot localize both time and frequency to arbitrary precision. Recent approaches are based on 
expressing signals in terms of wavelets (much like the Fourier series). Wavelets are functions that show the 
“best” possible localization characteristics in both the time-domain and the frequency-domain, and are an 
area of intense ongoing research. 



10.11 The Cepstrum and Homomorphic Filtering 

Consider a signal x[n\. If we take the complex logarithm of its DTFT X(F) to get Xk{F) = In X(F), the 
inverse transform x k [n] is called the cepstrum (pronounced kepstrum) of x[n\. We have 


r 1/2 

X K (F)=lnX(F) x K [n]= [In X{F)]e j2nnF dF 

J- 1/2 

We can recover X(F') from Xk{F) by taking complex exponentials to give 

X(F) = | X{F)\eP^ F) = e XK( ' F) 

This allows us to obtain Xk(F) from the magnitude and phase of X(F) as follows 

X k (F) = In X(F) = In |X(F)| + j<f>(F) 

The cepstrum Xk[it] may then be expressed as 


x K [n = 


,1/2 ,1/2 

/ {\n\X(F)\)e j2 ™ F dF + j / (j)(F)e j2nvF dF 

J- 1/2 J- 1/2 


(10.35) 


(10.36) 

(10.37) 
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In other words, the cepstrum is a complex quantity. Its real part corresponds to the IDTFT of ln|X(F)| 
and is called the real cepstrum. The existence of the cepstrum is restricted by the nature of X(F). 
The cepstrum does not exist if X(F) = 0 over a range of frequencies because In |A(F)| is undefined. The 
cepstrum does not exist if X(F) is bipolar (zero at isolated frequencies where it changes sign) and exhibits 
phase jumps of ±7r. In fact, the cepstrum does not exist unless the phase </>(F) is a continuous single valued 
function of frequency (with no phase jumps of any kind) and equals zero at F = 0 and F = 0.5. We can get 
around these problems by working with the unwrapped phase (to eliminate any phase jumps of ±27r) and, 
when necessary, adding a large enough positive constant to X(F ) to ensure X(F) > 0 for all frequencies 
(and eliminate any phase jumps of ± 7 r). 


10.11.1 Homomorphic Filters and Deconvolution 

Deconvolution is a process of extracting the input signal from a filter output and its transfer function. Since 
the convolution y[n] = x[n] * h[n\ transforms to the product Y(F) = X(F)H(F ), we can extract a:[n] from 
the inverse transform of the ratio X(F) = Y(F)/H(F). We may also perform deconvolution using cepstral 
transformations. The idea is to first find the cepstrum of y[n) by starting with start with Y(F) = X(F)H(F) 
to obtain 

Y k {F) = In Y(F) = In X (F) + In H(F) = X K {F) + H K {F) (10.38) 

Inverse transformation gives 

y K [n] = x K [n\ + h K [n\ (10.39) 

Notice how the convolution operation transforms to a summation in the cepstral domain. 

y[n] = x[n} -kh[n\ UK[n] = xk[v\ + hx[n\ (10.40) 

Systems capable of this transformation are called homomorphic systems. 

If xk\w\ /i/<-[n] lie over different ranges, we may extract by using a time window w[n] whose 

samples equal 1 over the extent of x k [n] and zero over the extent of hpc[n] ■ This operation is analogous 
to filtering (albeit in the time domain) and is often referred to as homomorphic filtering. Finally, we 
can use Xk[ti] to recover x[n] by first finding Xk(F), then take its exponential to give X(F) and finally 
evaluating its inverse transform. A homomorphic filter performs deconvolution in several steps as outlined 
in the following review panel. 


REVIEW PANEL 10.21 
Homomorphic Filtering and Cepstral Analysis 


Transform of Cepstrum: Y k (F) =lnV(F) 
Cepstrum: j//f[n] = a;^[n] + h.K[n} 
Windowed Cepstrum: yK[n\w[n\ — Xx[n] 
Signal Recovery: Xif [n] <=\ DTFT~|=» Xk{F) 


ln[X(F)H(F)] = In X(F) + In H(F) 


e x K ( F ) = X (F) 


X k (F) + H k (F) 


Cepstral methods and homomorphic filtering have found practical applications in various fields including 
deconvolution, image processing (restoring degraded images), communications (echo cancellation), speech 
processing (pitch detection, dynamic range expansion, digital restoration of old audio recordings) and seismic 
signal processing. 
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10.11.2 Echo Detection and Cancellation 

Cepstral methods may be used to detect and remove unwanted echos from a signal. We illustrate echo 
detection and cancellation by considering a simple first order echo system described by 

y[n] = x[n] + ax[n — D] (10.41) 

Here, ax[n — D] describes the echo of strength a delayed by D samples. It is reasonable to assume that 
a < 1 since the echo magnitude will be less than that of the original signal x[n\. In the frequency domain, 
we get 

Y{F) = X(F) + aX(F)e~ j2 ” FD 

The transfer function of the system that produces the echo may be written as 

H ( F ) = y = 1 + ae~^ FD (10.42) 

Now, we find Hk(F) = In H(F) to yield the transform of the cepstrum hx/n] as 

H k (F) = In H(F) = ln[l + ae~ j27rFD ] (10.43) 

Note that Hk{F) is periodic in F with period 1/D and, as a consequence, the cepstrum h k [n], describes a 
signal with sample spacing D. To formalize this result, we invoke the series expansion 

00 k 

ln(l + r) = 5>l) fe+1? -, |r| < 1 

k=l 

With r = ae~i 2nFD in the above result, we can express Hk(F) as 

00 k 

H k (F ) = ln[l + ae~^ FD ] = V(-l f+^°L e -i^kFD ( 10 . 44 ) 

/c 

k =1 

Its inverse transform leads to the cepstrum Hk [n\ of the echo-producing system as 

00 k 

h K [n] = y'(-l ) A ,1< f <5(U - kD) (10.45) 

fc=l 

Note that this cepstrum h /<- [n] is an impulse train with impulses located at integer multiples of the delay D. 
The impulses alternate in sign and their amplitude decreases with the index k that equals integer multiples 
of the delay. 

Since y[n\ = x[n\ * h[n], its cepstral transformation leads to 

y K [n] = x K [n\ + h K [n] Y K (F) = X K (F) + H k (F) (10.46) 

We see that the cepstrum y/c[n] of the contaminated signal y[n] equals the sum of the cepstrum XK[n\ of the 
original signal x[n] and an impulse train Iik [n] whose decaying impulses alternate in sign and are located at 
multiples of the delay D. If the spectra Xk(F) and FIk{F) occupy different frequency bands, FIk{F) may 
be eliminated by ordinary frequency domain filtering and lead to the recovery of x[n\. Since contains 

impulses at multiples of D , we may also eliminate the unwanted echoes in the cepstral domain itself by using 
a comb filter whose weights are zero at integer multiples of D and unity elsewhere. Naturally, the comb 
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filter can be designed only if the delay D is known a priori. Even if D is not known, its value may still be 
estimated from the location of the impulses in the cepstrum. 

As an example of echo cancellation by homomorphic signal processing, consider the clean signal x[n\ = 
(0.9)™u[n] contaminated by its echo delayed by 20 samples and with a strength of 0.8. The contaminated 
signal y[n] is then given by 

y[n] = x[n\ + 0.8x[n — 20] 

Our objective is to recover the clean signal x[n] using cepstral techniques. A 64-sample portion of x[n\ and 
y[n] is shown in Figure 10.13(b). The complex cepstrum of the contaminated signal y[n] is displayed in 
Figure 10.13(a) and is a practical approximation based on the 64-point FFT (to approximate the DTFT). 
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(a) Complex cepstrum of echo signal 




0 20 40 60 


(b) Original and echo signal, N = 64 


Figure 10.13 Complex cepstrum (a) of the echo signal in (b) 


The appearance of the cepstral spikes (deltas) at n = 20, 40, 60 indicates a delay of D = 20 as expected. 
Once these spikes are removed, we get the cepstrum shown in Figure 10.14(a). The signal corresponding to 
this cepstrum is shown in Figure 10.14(b) and clearly reveals the absence of the echo signal. 
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(a) Cepstrum with deltas removed 




(b) Original and echo-cancelled signal 


Figure 10.14 Complex cepstrum (a) with spikes removed and its corresponding signal (b) 


However, the correspondence with the clean signal is not perfect. The reason is that the complex cepstrum 

still contains spikes at the indices n = 80,100,120 ... that get aliased to n = 16, 36, 56,_ These aliases are 

visible in Figure 10.14(a) and are the consequence of using the FFT to approximate the true cepstrum. Once 
these aliased spikes are also removed, we get the cepstrum of Figure 10.15(a). The signal corresponding to 
this cepstrum, shown in Figure 10.15(b), is now an almost exact replica of the original clean signal. 


©Ashok Ambardar, September 1, 2003 









10.12 Optimal Filtering 


447 


1 


0.5 



-0.5 1 -■-■-'- J 

0 20 40 60 

(a) Cepstrum with aliased deltas removed 

Figure 10.15 Complex cepstrum (a) with aliased 



(b) Original and echo-cancelled signal 
S3 removed and its corresponding signal (b) 


10.12 Optimal Filtering 

For a filter with impulse response is h[n], the output y[n] is described by the convolution y[n] = x[n] * h[n]. 
Ideally it is possible to recover x[n\ by deconvolution. However, if the output is contaminated by noise or 
interference, an optimal filter provides a means for recovering the input signal. Such a filter is optimized in 
the sense that its output, when deconvolved by h[n], results in a signal x[n\ that is the best (in some sense) 
approximation to x[n}. Suppose the contaminated response u;[?r] equals the sum of the ideal response y[n] 
and a noise component s[n] such that 



ideal output noise 


(10.47) 


If we pass this signal through an optimal filter with a transfer function < f>(F'), the filter output in the frequency 
domain equals IF(F') < I>(.F). When we deconvolve this by h[n], we obtain x[n]. In the frequency domain this 
is equivalent to finding X(F ) as the ratio 

^ _ W(F)*(F) _ *(F)[Y(F) + S(F)] 

' ( ' H(F) H(F) 

If x[n\ is to be the best approximation to x\n] in the least square sense, we must minimize the mean (or 
integral) square error. Since the error equals x[n] — x[n\, the mean square error e may be written as 

oo ,.1/2 

e = V \x[n] ~ x[n}\ 2 dt = / \X{F) - X{F )\ 2 dF 

•'- 1/2 


Substituting for X(F) and X(F), we get 

f 1/2 \Y(F)-Q(F)\Y(F) + S(F)]| 2 


'- 1/2 


l^)l s 


dF = 


nl/2 \Y(F)[l-$(F)]~ S(F)$(F)\ 2 


I- 1/2 


\H(F)f 


dF 


If the noise s[n] and signal y[n] are uncorrelated (as they usually are), the integral of the product Y(F)S(F) 
equals zero and we obtain 


1,1/2 |V(F)| 2 |1 - $(F)| 2 + |5’(F)| 2 |$(F)| s 


r*l/2 


/- 1/2 


|U(F )| 2 


dF = 


/ — 1/2 


K{F) dF 
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To ensure that e is a minimum, the kernel K(F) must be minimized with respect to (F). So, we set 
dK(F)/d$(F) = 0 and (assuming that 4>(F) is real), this leads to the result 

*(F) = _FTF_ 

1 j \Y(F)\ 2 + |5(F)| 2 

This result describes a Wiener (or Wiener-Hopf) optimal filter. Note that <1>(F) = 1 in the absence of 
noise and <I>(F) ss 0 when noise dominates. In other words, it combats the effects of noise only when required. 
Interestingly, the result for 4>(F) does not depend on X(F) even though it requires that we obtain estimates 
of |Y(F)| and |5'(A 7 ')| 2 separately. In theory, this may indeed be difficult without additional information. In 
practice however, the power spectral density (PSD) |1F(F)| 2 may be approximated by 

|W(F)| 2 «|Y(F)| 2 +|F(F)| 2 


In addition, the noise spectral density IS'(F)! 2 often has a form that can be deduced from its high frequency 
behaviour. Once this form is known, we estimate |Y(F)| 2 = |IF(F)| 2 — |£(F)| 2 (by graphical extrapolation, 
for example). Once known, we generate the optimal filter transfer function and the spectrum of the estimated 
input as 

\Y(F)\ 2 „, \Y(F)\ 2 * 1W) 

1 1 |Y(F)| 2 + |S(F)| 2 ~ \W{F)\ 2 [ ’ H{F) 

The inverse transform of X(F) leads to the desired time domain signal x[n\. We remark that the transfer 
function $(F) is even symmetric. In turn, the impulse response is also even symmetric about n = 0. This 
means that the optimal filter is noncausal. The design of causal optimal filters is much more involved and 
has led to important developments such as the Kalman filter. 

In practice, the DFT (or its FFT implementation) is often used as a tool in the optimal filtering of 
discrete-time signals. The idea is to implement the optimal filter transfer function and signal estimate by 
the approximate relations 


$[*] 


\Y[k]\ 2 

IW + IW 


\y\MI 

\W[k}\ 2 


X[k] 


W[k]$[k] 

m 


Here, W[k\ is the DFT of w[n\ which allows us to generate |IT[fc]| 2 , estimate |Y[fc]| 2 and then compute the 
transfer function $[fc] of the optimal filter. We also compute H[k], the DFT of h[n\ which leads to the 
spectrum of the estimated input as X[k] = IT[£;] < I>[fc]/.ff [fc]. The IDFT of this result recovers the signal x[n}. 
This approach has its pitfalls however, and may fail, for example, if some samples of H[k] are zero. 


10.13 Matrix Formulation of the DFT and IDFT 

If we let Wn — exp(— j2n/N), the defining relations for the DFT and IDFT may be written as 

N -1 


-Adft [fc] = ^x[n]W^ fe , k = 0,1,..., N -1 

n—0 
1 "- 1 

x[n] = jj'52x liFT [k][W$ t ]*, n = 0,1,... ,N — 1 

k=0 

The first set of N DFT equations in N unknowns may be expressed in matrix form as 

X = W w x 


(10.48) 

(10.49) 


(10.50) 
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Here, X and x are (N x 1) matrices, and Wy- is an (TV x N) square matrix called the DFT matrix. The 
full matrix form is described by 


' *[0] 



W° N 

W° N 

. w° 


’ *[o] 

X[l] 



wk 

W 2 N 

. w"- 1 


*[!] 

m 

= 

W° N 

W 2 N 

n 

. W 2 N (N ~ l) 


*[2] 

X[N - 1] 


. w° N 

W r 1 

w^ N ~ 1] . 

■ vv N J 


x[N — 1] 


(10.51) 


The exponents t in the elements of Wjv are called twiddle factors. 


EXAMPLE 10.14 (The DFT from the Matrix Formulation) 

Let x[n] = {1, 2, 1, 0}. Then, with N = 4 and IFy = exp(— j'27t/4) = —j, the DFT may be obtained by 
solving the matrix product: 


' X[0] ' 


' W° N W° N W° N W° N ' 


' *[ 0 ] ' 


' 1 1 1 1 ' 


' 1 ' 


4 

X[l] 


w° N w l N w 2 n w% 


*[1] 


1 —j -1 j 


2 


— J'2 

X[2] 


w% w 2 w* w% 


x[2] 


1-1 1-1 


1 


0 

_ X[3] _ 


_ w% w% w% w% _ 


_ x[3] _ 


. 1 3 - 1 —J _ 


0 


J'2 


The result is Xdft[^] = {4, —j 2, 0, j 2}. 


10.13.1 The IDFT from the Matrix Form 

The matrix x may be expressed in terms of the inverse of W n as 

x = W^'X (10.52) 

The matrix W^ 1 is called the IDFT matrix. We may also obtain x directly from the IDFT relation 
in matrix form, where the change of index from n to k , and the change in the sign of the exponent in 
exp(j2imk/N), lead to a conjugate transpose of Wjv. We then have 

X =^[W * N fX (10.53) 

Comparison of the two forms suggests that 

W^=^[W^] T (10.54) 

This very important result shows that W^ 1 requires only conjugation and transposition of Wat, an obvious 
computational advantage. 

The elements of the DFT and IDFT matrices satisfy A i: j = Such matrices are known as 

Vandermonde matrices. They are notoriously ill conditioned insofar as their numerical inversion. This 
is not the case for Wat, however. The product of the DFT matrix Wat with its conjugate transpose matrix 
equals the identity matrix I. Matrices that satisfy such a property are called unitary. For this reason, the 
DFT and IDFT, which are based on unitary operators, are also called unitary transforms. 


©Ashok Ambardar, September 1, 2003 



450 


Chapter 10 The Discrete Fourier Transform and its Applications 


10.13.2 Using the DFT to Find the IDFT 

Both the DFT and IDFT are matrix operations, and there is an inherent symmetry in the DFT and IDFT 
relations. In fact, we can obtain the IDFT by finding the DFT of the conjugate sequence and then conjugating 
the results and dividing by N. Mathematically, 

x[n] = IDFT{X DFT [fc]} = ^(DFT{X£ FT [fe]}J (10.55) 

This result invokes the conjugate symmetry and duality of the DFT and IDFT, and suggests that the DFT 
algorithm itself can also be used to find the IDFT. In practice, this is indeed what is done. 


EXAMPLE 10.15 (Using the DFT to Find the IDFT) 

Let us find the IDFT of XoFrlfc] = {4, —j 2, 0, j 2} using the DFT. First, we conjugate the sequence to get 
XqftM = {4, j2, 0, —j2}. Next, we find the DFT of A' F)FT [fc], using the 4x4 DFT matrix of the previous 
example, to give 


DFT{X£ FT [fc]} 


1 1 
1 -3 
1 -1 
1 3 



4 ' 


' 4 ' 


—J'2 


8 


0 


4 


j2 


0 


Finally, we conjugate this result (if complex) and divide by N = 4 to get the IDFT of X DFT [fc] as 

IDFT {X DFT [k ]} = i{4, 8, 4, 0} = {1, 2, 1, 0} 


10.14 The FFT 

The importance of the DFT stems from the fact that it is amenable to fast and efficient computation using 
algorithms called fast Fourier transform, or FFT, algorithms. Fast algorithms reduce the problem of 
calculating an iV-point DFT to that of calculating many smaller-size DFTs. The key ideas in optimizing the 
computation are based on the following ideas. 

Symmetry and Periodicity 

All FFT algorithms take advantage of the symmetry and periodicity of the exponential Wn = exp(— j2nn/N) l 
as listed in Table 10.5. The last entry in this table, for example, suggests that W N / 2 = exp(j27rn/0.5A) is 
periodic with period -j. 


Table 10.5 Symmetry and Periodicity of Wn = exp(—j2n/N) 


Entry 

Exponential Form 

Symbolic Form 

1 

e ~j2Tvn/N _ e ~j2ir(n+N)/N 

W™ +N = 

2 

e ~j2ir(n+N/2)/N _ _ e ~j2im/N 

W™ +N/ 2 = -w% 

3 

e -j2-Kl< _ e ~j2nNK/N _ ^ 

W$ K = 1 

4 

e -j2(2n/N) = e -j2iv/{N/2) 

Wl = W N/2 
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Choice of Signal Length 

We choose the signal length TV as a number that is the product of many smaller numbers Tk such that 
TV = rir 2 ■ ■ ■ r m . A more useful choice results when the factors are equal, such that TV = r m . The factor r 
is called the radix. By far the most practically implemented choice for r is 2, such that TV = 2 m , and leads 
to the radix-2 FFT algorithms. 

Index Separation and Storage 

The computation is carried out separately on even-indexed and odd-indexed samples to reduce the compu¬ 
tational effort. All algorithms allocate storage for computed results. The less the storage required, the more 
efficient is the algorithm. Many FFT algorithms reduce storage requirements by performing computations 
in place by storing results in the same memory locations that previously held the data. 

10.14.1 Some Fundamental Results 

We begin by considering two trivial, but extremely important, results. 

• 1-point transform: The DFT of a single number A is the number A itself. 

• 2-point transform: The DFT of a 2-point sequence is easily found to be 

Adft[ 0] = x[0] + a:[l] and X DFT [1] = x[0] - x[l] (10.56) 

The single most important result in the development of a radix-2 FFT algorithm is that an TV-sample 
DFT can be written as the sum of two ^-sample DFTs formed from the even- and odd-indexed samples of 
the original sequence. Here is the development: 



N- 1 

JV/2-1 


N/2-1 

A’dft [fc] = 

= 5> 

II 

§? 

E - 

[2n}W^ nk ^ 

- E x i 2: 


n=0 


n—0 


71—0 


iV/2—1 



N/2-1 


A’dft [k] = 

= E 

x[2 n]W 2 N nk 

+ w* 

x[2n 

+1 }W^ nk 


n —0 



n—0 



N/2-1 



JV/2-1 


= 

- E 

x[MW &} 2 

+ W N 

a:[2n 

+ mm 


n—0 n=0 


If X e [k\ and X°[k] denote the DFT of the even- and odd-indexed sequences of length TV/2, we can rewrite 
this result as 

X DFT [fc] = X e [k} + W%X°[k], k = 0,1,2,...,TV —1 (10.57) 

Note carefully that the index k in this expression varies from 0 to TV — 1 and that X e [k] and X° [fc] are both 
periodic in k with period TV/2; we thus have two periods of each to yield Adft[&]- Dug to periodicity, we 
can split A'dft [k] and compute the first half and next half of the values as 


A dft [k] = X e [k] + W^X°[k], 

k = 0,1,2,.. 

I TV - 1 

• 5 2 

X DFT [k+X] = x e [k+\N\ + W k N + 

f X°[k+ f] 


= X e [k] — W^X°[k], 

k = 0,1, 2,.. 

^-1 
. , 2 ^ 
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4 = X e [k] 
B = X°[k] 



Figure 10.16 A typical butterfly 


This result is known as the Danielson-Lanczos lemma. Its signal-flow graph is shown in Figure 10.16 and 
is called a butterfly due to its characteristic shape. 

The inputs X e and X° are transformed into X e + W^X° and X e — W^X°. A butterfly operates on one 
pair of samples and involves two complex additions and one complex multiplication. For N samples, there 
are N/2 butterflies in all. Starting with N samples, this lemma reduces the computational complexity by 
evaluating the DFT of two ^-point sequences. The DFT of each of these can once again be reduced to the 
computation of sequences of length N/ 4 to yield 

X e [k) = X ee [k] + W% /2 X eo [k] X°[k\ = X oe [k] + W% /2 X°°[k\ (10.58) 

Since Wjy/ 2 = Wffi, we can rewrite this expression as 

X e [k] = X ee [k] + Wl k X eo [k] X°[k\ = X oe [k] + W^ k X°°[k] (10.59) 

Carrying this process to its logical extreme, if we choose the number N of samples as N = 2 m , we can reduce 
the computation of an IV-point DFT to the computation of 1-point DFTs in m stages. And the 1-point 
DFT is just the sample value itself (repeated with period 1). This process is called decimation. The FFT 
results so obtained are actually in bit-reversed order. If we let e = 0 and o = 1 and then reverse the 
order, we have the sample number in binary representation. The reason is that splitting the sequence into 
even and odd indices is equivalent to testing each index for the least significant bit (0 for even, 1 for odd). 
We describe two common in-place FFT algorithms based on decimation. A summary appears in Table 10.6. 

10.14.2 The Decimation-in-Frequency FFT Algorithm 

The decimation-in-frequency (DIF) FFT algorithm starts by reducing the single N- point transform at each 
successive stage to two (J -point transforms, then four J -point transforms, and so on, until we arrive at N 1- 
point transforms that correspond to the actual DFT. With the input sequence in natural order, computations 
can be done in place, but the DFT result is in bit-reversed order and must be reordered. 

The algorithm slices the input sequence x[n] into two halves and leads to 

N-l N/ 2-1 N/ 2-1 N/2—1 N/ 2-1 

Adft [k\=J2 x M W N= E x M W N k + E x \ n \ W N k = E x M w n + E x[n + N/2}W^ + ^ )k 

n—0 n—0 n=N/ 2 n=0 n =0 

This may be rewritten as 

N/2—1 N/2—1 N/2—1 N/2—1 

Adft [k]= + E *["+f ] W N= E *[«TO fc + (- l) fc E *[ n +f \ W N k 

n—0 n—0 n=0 n—0 
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Table 10.6 FFT Algorithms for Computing the DFT 


Entry 

Characteristic 

Decimation in Frequency 

Decimation in Time 

1 

Number of samples 

N = 2 m 

II 

to 

3 

2 

Input sequence 

Natural order 

Bit-reversed order 

3 

DFT result 

Bit-reversed order 

Natural order 

4 

Computations 

In place 

In place 

5 

Number of stages 

m = log 2 N 

m = log 2 N 

6 

Multiplications 

Y log 2 N (complex) 

Y log 2 N (complex) 

7 

Additions 

N log 2 N (complex) 

N log 2 N (complex) 


Structure of the zth Stage 


8 

No. of butterflies 

N 

2 

N 

2 

9 

Butterfly input 

A (top) and B (bottom) 

A (top) and B (bottom) 

10 

Butterfly output 

(A + B) and {A - B)W t N 

{A + BW^) and {A - BW* N ) 

11 

Twiddle factors t 

2 i ~ 1 Q, Q = 0,1,...,P—1 

2 m ~ i Q, Q = 0,1,..., P — 1 

12 

Values of P 

p _ 2 fn—i 

P = 2 i_1 


Separating even and odd indices, and letting x[n] = x a and x[n + N/ 2] = x b , 

N/ 2—1 

X DFT [2fc] = Y [x a + x b ]W 2 N nk , A: = 0,1,2,..., f -1 (10.60) 

71= 0 

N/2-1 N/2—1 

A DFT [2fc+l] = Y [x a - x b ]w% k+1)n = Y [x a -x b }W^W 2nk , k = 0,l,...,f-l (10.61) 

n—0 n—0 

Since IF^" 4 ' = W^ k 2 , the even-indexed and odd-indexed terms describe a ^-point DFT. The computations 
result in a butterfly structure with inputs x[n] and x[n + ^], and outputs Adft[ 2A:] = {x[n] + x[n + ^]} 
and Vd F t[2A: + 1] = {a;[n] — x[n + y ]}IF) }. Its butterfly structure is shown in Figure 10.17. 


A = X e [A] 
B = X°[A] 



A + B 


W' 

<X)— (A-B)W' 



Figure 10.17 A typical butterfly for the decimation-in-frequency FFT algorithm 


The factors IF 4 , called twiddle factors, appear only in the lower corners of the butterfly wings at each 
stage. Their exponents t have a definite order, described as follows for an N = 2 m -point FFT algorithm 
with m stages: 

1. Number P of distinct twiddle factors IF 4 at zth stage: P = 2 m ~ l . 

2. Values of t in the twiddle factors IF 4 : t = 2 l ~ 1 Q with Q = 0,1,2,..., P — 1. 
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The DIF algorithm is illustrated in Figure 10.18 for TV = 2, N = 4, and N = 8. 



000 

100 

010 

110 

001 

101 

Oil 

111 


Figure 10.18 The decimation-in-frequency FFT algorithm for N = 2, 4, 8 


EXAMPLE 10.16 (A 4-Point Decimation-in-Frequency FFT Algorithm) 

For a 4-point DFT, we use the above equations to obtain 

l 

A DFT [2fc] = ^{x[n]+x[n + 2\}Wl nk 

n =0 
1 

X DFT [2k + l] = ^{x[?r] ~x[n + 2]}W%Wl nk , k = 0,1 

n—0 

Since W® = 1 and IT| = — 1, we arrive at the following result: 

X DF t[0] = x[0] + x[2] + x[l] + x[3] A dft [2] = x[0] + x[2] - {x[l] + x[3]} 

A dft [ 1] = x[0] - x[2] + W 4 {x[ 1] - x[3]} X DFT [3] = x[0] - ®[2] - W 4 {x[ 1] - *[3]} 

We do not reorder the input sequence before using it. 


10.14.3 The Decimation-in-Time FFT Algorithm 

In the decimation-in-time (DIT) FFT algorithm, we start with N 1-point transforms, combine adjacent pairs 
at each successive stage into 2-point transforms, then 4-point transforms, and so on, until we get a single 
TV-point DFT result. With the input sequence in bit-reversed order, the computations can be done in place, 
and the DFT is obtained in natural order. Thus, for a 4-point input, the binary indices {00,01,10,11} 
reverse to {00,10, 01,11}, and we use the bit-reversed order {#[0], x[2], x[l], x[3]}. 

For an 8-point input sequence, {000,001,010,011,100,101,110,111}, the reversed sequence corresponds 
to {000,100,010,110, 001,101,011,111} or {x[0], x[4], x[6], x[2], x[l], x[5], x[3], x[7]}, and we use this sequence 
to perform the computations. 

At a typical stage, we obtain 

X DFT [k] =X e [k) + W^X°[k] X UFT [k + ^] = X e [k] - W^X°[k] (10.62) 
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Its butterfly structure is shown in Figure 10.19. 


4 = X e [k] 
B = X°\k\ 



Figure 10.19 A typical butterfly for the decimation-in-time FFT algorithm 


As with the decimation-in-frequency algorithm, the twiddle factors W l at each stage appear only in the 
bottom wing of each butterfly. The exponents t also have a definite (and almost similar) order described by 

1. Number P of distinct twiddle factors W l at zth stage: P = 2 l ~ 1 . 

2. Values of t in the twiddle factors W 4 : t = 2 m ~ l Q with Q = 0,1,2,..., P — 1. 

The DIT algorithm is illustrated in Figure 10.20 for TV = 2, N = 4, and N = 8. 



A[()J 
■X[l] 
•X[2] 
A[3J 
■X[4] 
•X[5] 
A [6] 
X\7] 


Figure 10.20 The decimation-in-time FFT algorithm for N = 2, 4, 8 
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In both the DIF algorithm and DIT algorithm, it is possible to use a sequence in natural order and get 
DFT results in natural order. This, however, requires more storage, since the computations cannot now be 
done in place. 


EXAMPLE 10.17 (A 4-Point Decimation-in-Time FFT Algorithm) 

For a 4-point DFT, with W\ — e - -? 71 ’/ 2 = —j, we have 

3 

-V D ft [k] = x[n]W2 k , k = 0,1,2,3 

n —0 


We group by even-indexed and odd-indexed samples of x[n] to obtain 


X DFT [fc] = X e [k] + W*X°[k\ 


f X e [k\=x[0) + x[2)Wi k , 
{ X°[k}= x[l}+x[3}Wi k , 


k = 0,1,2,3 
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Using periodicity, we simplify this result to 

X DFT [k] = x e [k} + W%X°[k\ I X e [k) = ®[0] + x[2 }Wi k , 

X DFT [k + ±TV] = X e [k\ - W k X°[k\ \ X°[k\ = x[l] + x[3]Wi k , ’ 

These equations yield Adft[0] through Adft[3] as 

Adft[0] = A e [0] + W°X o [0\ = *[0] + x[2 ]W 4 ° + W 4 °{x[l] + z[3]IU 4 0 } 
A DF t[1] = A e [l] + WlX°[\] = ar[0] + x[2 ]W 4 2 + W\{x[ 1] + x[3]IU 4 2 } 
Adft[2] = X e [0] - IU 4 °A°[0] = ®[0] + x[2]W? - W 4 °{x[l] + x[3]IU 4 0 } 
A dft [3] = A e [l] - WlX°[l] = ®[0] + x[2]Wi - W\{x[ 1] + x[3]W|} 

Upon simplification, using W 4 = 1, W\ = W 4 = 1, and W 4 = —1, we obtain 

AT D ft[0] = *[0] + x[2\ + x[l] + ar[3] X DF t[1] = *[0] - x[2] + W 4 {x[ 1] - ®[3]} 
A dft [2] = ®[0] + x[2\ - {cc[l] + a[3]} A DFT [3] = *[0] - x[2) - W 4 {x[ 1] - ar[3]> 


10.14.4 Computational Cost 

Both the DIF and DIT iV-point FFT algorithms involve m = log 2 N stages and 0.5JV butterflies per stage. 
The FFT computation thus requires 0.5 mN = 0.5N \og 2 N complex multiplications and rnN = N log 2 N 
complex additions. Table 10.7 shows how the FFT stacks up against direct DFT evaluation for N = 2 m , 
counting all operations. Note, however, that multiplications take the bulk of computing time. 


Table 10.7 Computational Cost of the DFT and FFT 


Feature 

TV-Point DFT 

TV-Point FFT 

Algorithm 

Solution of TV equations 
in TV unknowns 

0.5TV butterflies/stage, m stages 
Total butterflies = 0.5mTV 

Multiplications 

TV per equation 

1 per butterfly 

Additions 

TV — 1 per equation 

2 per butterfly 

Total multiplications 

TV 2 

0.5toTV = 0.5TVlog 2 TV 

Total additions 

TV(TV - 1) 

mN = TV log 2 TV 


The difference between 0.5 log 2 N and N 2 may not seem like much for small N. For example, with N = 16, 
0.5iVlog 2 N = 64 and N 2 = 256. For large N, however, the difference is phenomenal. For N = 1024 = 2 10 , 
0.5iVTog 2 N « 5000 and N 2 « 10 6 . This is like waiting 1 minute for the FFT result and (more than) 3 hours 
for the identical direct DFT result. Note that N\og 2 N is nearly linear with N for large N, whereas N 2 
shows a much faster, quadratic growth. 

In the DFT relations, since there are N factors that equal W° or 1, we require only N 2 — N complex 
multiplications. In the FFT algorithms, the number of factors that equal 1 doubles (or halves) at each stage 
and is given by 1 + 2 + 2 2 + • • • + 2 m ~ 1 = 2 m — 1 = TV — 1. We thus actually require only 0.5TV log 2 TV — (TV — 1) 
complex multiplications for the FFT. The DFT requires TV 2 values of W k , but the FFT requires at most 
TV such values at each stage. Due to the periodicity of W k , only about |TV of these values are distinct. 
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Once computed, they can be stored and used again. However, this hardly affects the comparison for large N. 
Since computers use real arithmetic, the number of real operations may be found by noting that one complex 
addition involves two real additions, and one complex multiplication involves four real multiplications and 
three real additions (because (A + jB)(C + jD) = AC — BD + jBC + jAD). 

Speed of Fast Convolution 

A direct computation of the convolution of two ./V-sample signals requires N 2 complex multiplications. 
The FFT method works with sequences of length 2 N. The number of complex multiplications involved is 
2(7Vlog 2 2 N) to find the FFT of the two sequences, 2 N to form the product sequence, and N log 2 N to find 
the IFFT sequence that gives the convolution. It thus requires 3N log 2 2 N + 2N complex multiplications. If 
N = 2 m , the FFT approach becomes computationally superior only for m > 5 (N > 32) or so. 

10.15 Why Equal Lengths for the DFT and IDFT? 

The DTFT of an ./V-sample discrete time signal x[n] is given by 

N-l 

X P (F) = x[n]e- j2 ™ F (10.63) 

n—0 

If we sample F at M intervals over one period, the frequency interval F 0 equals 1/M and F —> kF 0 = 
jj, k = 0,1,..., M — 1, and we get 

N—l 

X DF t[&] = x[n}e~ j2nnk/M , k = 0,1,..., M - 1 (10.64) 

n—0 

With Wm = e -j27r / M , this equation can be written as 

N-l 

*D FT [fc] = x l n \ W M, k = 0,1 ,...,M - 1 (10.65) 

n—0 

This is a set of M equations in N unknowns and describes the M-point DFT of the N-sample sequence x[n\. 
It may be written in matrix form as 

X = W M x (10.66) 

Here, X is an M x 1 matrix, x is an N x 1 matrix, and Wm is an (M x N) matrix. In full form, 

W° M W° M w° M ... W° M -I r x[o\ 

W°M Wl r W 2 m ... W ^- 1 x[l] 

W° M w 2 m w\, ... wT- 1 ' ( 10 - 67 ) 

W° M w M- 1 ... w^ M -v\ L *[JV-1] _ 
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EXAMPLE 10.18 (A 4-Point DFT from a 3-Point Sequence) 

Let x [n] = {1, 2, 1}. We have N = 3. The DTFT of this signal is 

X P (F) = 1 + 2e~ j27lF + e~ j47lF = [2 + 2cos(27rF)] e -- J ' 27rF 


If we pick M = 4, we have F = k/4 , k = 0,1,2,3, and obtain the DFT as 

X BFT [k] = [2 + 2cos(27rfc/4)]e-^ fc / 4 , k = 0,1, 2,3 or X DFT [k] = {4, -j2, 0, j2} 
Using matrix notation with Wm = e _j27r / 4 = —j, we can also find X DFT [fc] as 


111 
1 -j -1 
1-1 1 
1 j -1 


X[0] ■ 


' w° M 

W° M 

W° M 

X[l] 


W° M 


w 2 m 

X[2\ 


W° M 

W 2 m 

W 4 m 

X[3] _ 


. w° M 

W 3 m 

W 6 m 



' *[ 0 ] ■ 



*[!] 

= 


. x[2] _ 




' 1 ' 
2 

Q 


r 4i 


= 

I 

o to 


O 


L j 2 J 


Thus, Xdpt [k] = {4, —j 2, 0, j2}, as before. 


10.15.1 The Inverse DFT 

How do we obtain the iV-sample sequence x[n] from the M-sample DFT? It would seem that we require the 
product of X, an M x 1 matrix with an N x M matrix to give x as an N x 1 matrix. But what is this 
(M x N) matrix, and how is it related to the M x N matrix Wm? To find out, recall that 

X p (F)e j2nnF dF (10.68) 

Converting this to discrete form with F = kFo = jj results in periodicity of x[n] with period 1, and we 
obtain N samples of x[n] using 



M—1 

x[n] = X DFT [k}e j2nnk/M , n = 0,1,..., N - 1 (10.69) 

k -0 

For N < M, one period of x[n\ is a zero-padded M-sample sequence. For N > M, however, one period of 
x[n\ is the periodic extension of the A-sample sequence with period M. 

The sign of the exponent and the interchange of the indices n and k allow us to set up the matrix 
formulation for obtaining x[n] using an N x M inversion-matrix Wj that just equals jj times [W^ f ] T , the 
conjugate transpose of the M x N DFT matrix Wm- Its product with the N x 1 matrix corresponding 
to X[k] yields the M x 1 matrix for x[n]. We thus have the forward and inverse matrix relations: 

X = W M x (DFT) x = W,X = ^ [Wy T X (IDFT) (10.70) 

These results are valid for any choice of M and N. An interesting result is that the product of W m with 
W/ is the N x N identity matrix. 
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EXAMPLE 10.19 (A 3-Point IDFT from a 4-Point DFT) 

Let X DF T[fc] = {4, — j2, 0, j2} and M = 4. 

The IDFT matrix equals 


W, = 


1 


1 

3 

-1 


*T 


1 


-3 
-1 


1 

-1 

1 


3 

-1 


We then get the IDFT as 


= W,X = 


-3 
-1 


1 

-1 

1 


3 

-1 



4 ' 


' 1 ' 
2 


-J2 



0 


1 

- 

J'2 _ 



The important thing to realize is that x[n] is actually periodic with M = 4, and one period of x[n] is the 
zero-padded sequence {1, 2, 1, 0}. 


10.15.2 How Unequal Lengths Affect the DFT Results 

Even though the M -point IDFT of an TV-point sequence is valid for any M, the choice of M affects the 
nature of x[n\ through the IDFT and its inherent periodic extension. 

1. If M = TV, the IDFT is periodic, with period M, and its one period equals the TV-sample x[n]. Both 
the DFT matrix and IDFT matrix are square (M x M), and allow a simple inversion relation to go 
back and forth between the two. 

2. If M > TV, the IDFT is periodic with period M. Its one period is the original TV-sample x[n\ with 
M — TV padded zeros. The choice M > TV is equivalent to using a zero-padded version of x[n\ with a 
total of M samples and M x M square matrices for both the DFT matrix and IDFT matrix. 

3. If M < TV, the IDFT is periodic with period M < TV. Its one period is the periodic extension of the 
TV-sample x[n] with period M. It thus yields a signal that corresponds to x[n] wrapped around after 
M samples and does not recover the original x[n]. 


EXAMPLE 10.20 (The Importance of Periodic Extension) 

Let x[n] = (1, 2, 1}. We have N = 3. The DTFT of this signal is 

X P (F) = 1 + 2e~ j2wF + e~ j47lF = [2 + 2 cos(27rF)] e - i27rF 

We sample X P (F) at M intervals and find the IDFT as y[n]. What do we get? 

(a) For M = 3, we should get y[n] = {1, 2, 1} = x[n\. Let us find out. 

With TVf = 3, we have F = k/3 for k = 0,1, 2, and XDFT[fc] becomes 

^DFT[fc] = [2 + 2cos(2fc7r/3)]e _ - j2fc7r/3 = |4, -\~j\J\, j 
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We also find W/ and the IDFT x = W/X as 



This result is periodic with M = 3, and one period of this equals x[n]. 


(b) For M = 4, we should get a new sequence y[n\ = {1, 2, 1, 0} that corresponds to a zero-padded 
version of x[n]. 


(c) For M = 2, we should get a new sequence z[n] = {2, 2} that corresponds to the periodic extension of 
x[n] with period 2. 

With M = 2 and k = 0,1, we have Zvp^[k] = [2 + 2cos(7rfc)]e _ - jfc7r = {4, 0}. 

Since e~i 2 ' K l M = e ~• J7r = —1, we can find the IDFT z[n] directly from the definition as 

z[0] = 0.5{Xdft[0] + Xdft[1]} = 2 z[l] = 0.5{Xdft[0] — Xdft[1]} = 2 

The sequence z[n} = {2, 2} is periodic with M = 2. As expected, this equals one period of the periodic 
extension of x[n ] = {1, 2, 1} (with wraparound past two samples). 
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CHAPTER 10 PROBLEMS 

10.1 (DFT from Definition) Compute the DFT and DFS of the following signals. 

(a) x[n] = {1, 2, 1, 2} (b) x[n] = {2, 1, 3, 0, 4} 

(c) x[n) = { 2 , 2 , 2 , 2 } (d) x[n] = { 1 , 0 , 0 , 0 , 0 , 0 , 0 , 0 } 

[Hints and Suggestions: Compute the DFT only for the indices k < ^ and use conjugate symmetry 
about k = y and Xdft[-/V — k] = Xq FT [/c] to find the rest.] 

10.2 (DFT from Definition) Use the defining relation to compute the IV-point DFT of the following: 

(a) x[n] = 6 [n], 0 < n < N — 1 

(b) x[n] = a n , 0 < n < N — 1 

(c) x[n] = e j ™/ N , 0<n<N~l 

10.3 (IDFT from Definition) Compute the iDFT of the following. 

(a) -X DFT [fc] = {2, —j, 0, j} (b) X DFT [fc] = {4, —1, 1, 1, -1} 

(c) X DFT [k] = { 1 , 2 , 1 , 2 } (d) X OFT [k] = { 1 , 0, 0 , j, 0 , -j, 0 , 0 } 

[Hints and Suggestions: Each DFT has conjugate symmetry about k = so x[n] should be real. 
For (b)-(c), the DFT is also real, so x[n] has conjugate symmetry about k = ^.] 

10.4 (Symmetry) For the DFT of each real sequence, compute the boxed quantities. 

(a) X dft [A:] = {0, [*i], 2 + j, -1, [X4], .)} 

(b) X dft [A:] = {l, 2, [Xa], ^ 3 ], 0, 1 - j, -2, [x^] } 

[Hints and Suggestions: The DFT of a real signal shows conjugate symmetry about k = -y-] 

10.5 (Properties) The DFT of x[n] is = {1,2,3,4}. Find the DFT of each of the following 

sequences, using properties of the DFT. 

(a) y[n } = x[n — 2 ] (b) f[n] = x[n + 6 ] (c) g[n ] = x[n + 1 ] 

(d) h[n } = e- 5 " 7 r / 2 a;[n] (e) p[n] = x[?r]@a;[n] (f) q[n\ = x 2 [n] 

(g) r[n] = x[— n] (h) s[n] = x*[n ] (i) 'c[?r] = x 2 [—n] 

[Hints and Suggestions: In (a)-(c) use the shifting property. In (d), use circular shift of the DFT. 
In (e), square the DFT values. In (f), divide the periodic convolution by N. In (g), fold the DFT and 
create is periodic extension to get samples starting at k = 0. In (h), conjugate the results of (g).] 

10.6 (Properties) Let Xd F t[&] be the IV-point DFT of a real signal. How many DFT samples will always 
be real, and what will be their index kl [Hint: Use the concept of conjugate symmetry and consider 
the cases for odd N and even N separately.] 

[Hints and Suggestions: Check the DFT at k = 0 and k = % for even N and odd N.] 

10.7 (Properties) Let Xdft[I’] be the IV-point DFT of a (possibly complex) signal x[n]. What can you 
say about the symmetry of x[n] for the following Xoft^’]? 

(a) Conjugate symmetric 
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(b) Real but with no symmetry 

(c) Real and even symmetric 

(d) Real and odd symmetric 

(e) Imaginary and odd symmetric 

10.8 (Properties) For each DFT pair shown, compute the values of the boxed quantities. 

(a) {[a*], 3, -4, 0, 2 } <*=► { 5 , [xj], -1.28- j4.39, [x^, 8.78- jl. 4 } 

(b) {[a*], 3, -4, 2, 0, l} «=► {4, [xT], 4 — j5.2, [X 3 ], [x^, 4-jl.73} 

[Hints and Suggestions: Use conjugate symmetry. In (a) also use x[0] = ]C^DFT[fc] to find xq- In 
(b), also use Xdft[ 0] = ( or Parseval’s relation) to find X 3 .] 

J1 

10.9 (Properties) Let x[n] = {1, —2, 3, —4, 5, —6}. Without evaluating its DFT Xdft[&], compute 
the following quantities: 

5 5 5 

(a) .X[0] (b)^X[k] (c) A [3] (d)^|X[fc]| 2 (e) £ (-l) k X[k] 

k =0 k—0 k =0 

[Hints and Suggestions: In (a), also use X DF t[0] = T^x[n]. In (b), use ]T]X D ft[&] = 7Vx[0]. In (c), 
use XdftI^] = XX - b) n x[ri\. In (d), use Parseval’s relation. In (e), use XX - l) fe XDFT[fc] = 7Vx[y].] 

10.10 (DFT Computation) Find the jV-point DFT of each of the following signals. 

(a) x[n] = <5[n] (b) x[n] = S[n — K], K < N 

(c) x[n] = S[n — 0.57V] (TV even) (d) x[n\ = 6[n — 0.5(TV — 1)] (TV odd) 

(e) x[n] = 1 (f) x[n] = S[n — 0.5(7V — 1)] + 5[n — 0.5(TV + 1)] (TV odd) 

(g) x[n] = (— l) n (TV even) (h) x[n] = e j4 " 7r / JV 

(i) x[n\ = cos(^) (j) x[n\ = cos(^ + 0.25 tt) 

[Hints and Suggestions: In (a), the DFT has TV unit samples. Use this result with the shifting 
property in (b), (c), (d) and (f). In (e), only Xdft[ 0] is nonzero. In (g), (—1)" = cos(n7r). In (h), 
use frequency shift on the result of (e). In (i) and (j), F 0 = X anc i the DFT is a pair of impulses with 
amplitude 0.5Ne^ ±e at k = ±2.] 

10.11 (Properties) The DFT of a signal x[n] is -Xdft[&]- If we use its conjugate IdftM = -^dftM an d 
obtain its DFT as y [n ], how is y[n] related to x [n] ? 

[Hints and Suggestions: A typical DFT term is Ae J . Its IDFT gives terms of the form jjAe^e^ 
where <f> = 2n ^' K . Similarly, examine the DFT of the conjugated DFT sequence and compare.] 

4 

10.12 (Properties) Let X[k] = {l, —2, 1 — j, j 2, 0,...} be the 8-point DFT of a real signal x[n]. 

(a) Determine X[k] in its entirety. 

(b) What is the DFT Y[k] of the signal y[n] = (—1 ) n x[n]7 

(c) What is the DFT G[k] of the zero-interpolated signal g[n ] = x[n/2]? 

(d) What is the DFT H[k] of h\n] = {x[?r], x[n], x[?r]} obtained by threefold replication of x[n ]? 

[Hints and Suggestions: In (b), (—1 )™x[n] <t=> X[k — ^], so use circular shift. In (c), replicate the 
DFT. In (d), zero-interpolate X[k] to 3X[fc/3] (with two zeros after each DFT sample).] 

10.13 (Replication and Zero Interpolation) The DFT of x\n] is A'dft[^] = {1,2,3,4, 5}. 
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(a) What is the DFT of the replicated signal y[n] = {x[n],x[n]}? 

(b) What is the DFT of the replicated signal f[n] = {x[n], x[n], x[n]}? 

(c) What is the DFT of the zero-interpolated signal g[n] = x[n/ 2]? 

(d) What is the DFT of the zero-interpolated signal h[n] = x[n/3]? 

[Hints and Suggestions: In (a), insert a zero after each DFT sample. In (b), insert two zeros after 
each DFT sample. In (b) and (c), double or triple the DFT length by replicating it.] 

10.14 (DFT of Pure Sinusoids) Determine the DFT of x(t) = sm(2nfot + (without doing any DFT 
computations) if we sample this signal, starting at t = 0, and acquire the following: 

(a) 4 samples over 1 period (b) 8 samples over 2 periods 
(c) 8 samples over 1 period (d) 18 samples over 3 periods 

(e) 8 samples over 5 periods (f) 16 samples over 10 periods 

[Hints and Suggestions: The Nyquist rate corresponds to taking two samples per period. Set up 
the digital frequency as F 0 = The IV-point DFT of x[n] = Acos(27rF 0 n + 0), is a pair of nonzero 
samples, 0.5 Ae^ e at k = ko and 0.5 Ae~^ e at k = N — ko (all other samples are zero).] 

10.15 (DFT of Sinusoids) The following signals are sampled starting at t = 0. Identify the indices of the 
nonzero DFT components and write out the DFT as a sequence. 

(a) x(f) = cos(47rf) sampled at 25 Hz, using the minimum number of samples to prevent leakage 

(b) x(t) = cos(207rf) + 2sin(407rt) sampled at 25 Hz with N = 15 

(c) x(t) = sin(107rt) + 2sin(407rf) sampled at 25 Hz for 1 s 

(d) x(t) = sin(407rf) + 2sin(607rf) sampled at intervals of 0.004 s for four periods 

[Hints and Suggestions: Let F 0 = The IV-point DFT of x[n] = Acos(2nF 0 n + 0), is a pair of 
nonzero samples, 0 AAe^ e at k = ko and 0.5 Ae~^ e at k = N — ko (all other samples are zero).] 

10.16 (Aliasing and Leakage) The following signals are sampled and the DFT of the sampled signal 
obtained. Which cases show the effects of leakage. 

(a) A 100-Hz sinusoid for 2 periods at 400 Hz 

(b) A 100-Hz sinusoid for 4 periods at 70 Hz 

(c) A 100-Hz sinusoid at 400 Hz, using 10 samples 

(d) A 100-Hz sinusoid for 2.5 periods at 70 Hz 

(e) A sum of sinusoids at 100 Hz and 150 Hz for 100 ms at 450 Hz 

(f) A sum of sinusoids at 100 Hz and 150 Hz for 130 ms period at 450 Hz 

[Hints and Suggestions: Leakage occurs if we do not sample for integer periods. If Fq = jj , where 
k is an integer, leakage is avoided if we sample for k full periods (to obtain N samples).] 

10.17 (DFT Concepts) The signal x(t) = cos(1507rf) + cos(1807rf) is to be sampled and analyzed using 
the DFT. 

(a) What is the minimum sampling S m i n rate to prevent aliasing? 

(b) With the sampling rate chosen as S = 2S' m i n , what is the minimum number of samples A7 min 
required to prevent leakage? 

(c) With the sampling rate chosen as S = 25' m i n , and N = 3A m ; n , what is the DFT of the sampled 
signal? 


©Ashok Ambardar, September 1, 2003 




464 


Chapter 10 The Discrete Fourier Transform and its Applications 


(d) With S = 160 Hz and TV = 256, at what DFT indices would you expect to see spectral peaks? 
Will leakage be present? 

[Hints and Suggestions: In (b), TV m i„ =LCM(TVi,TV^) where TV — 1 and N 2 are the individual 
periods. In (c), the nonzero DFT samples occur at k\, k 2 , N m - m — fci, TV m i n — k 2 where F-\ = and 
F 2 = ^ 2 . . In (d), leakage occurs if any index of the form k = N fk/S is not an integer.] 

10.18 (DFT Concepts) The signal x(t) = cos(507rf) +cos(807rf) is sampled at S = 200 Hz. 

(a) What is the minimum number of samples required to prevent leakage? 

(b) Find the DFT of the sampled signal if x(t) is sampled for 1 s. 

(c) What are the DFT indices of the spectral peaks if TV = 128? 

[Hints and Suggestions: In (a), TV m ; n =LCM(TVi, TV 2 ) where TV — 1 and N 2 are the individual 
periods. In (b), the nonzero DFT samples occur at ki,k 2 , TV min — fci, TV min — k 2 where F\ = and 

-‘’min 

F 2 = j/f 2 —. In (c), the peaks occur at the integer indices closest to k = Nfk/S.] 

-‘’min ' J 

10.19 (DFT Concepts) Let x[n] = cos(2?r7rFo). 

(a) Use the defining relation to compute its TV-point DFT. 

(b) For what values of Fq would you expect aliasing and/or leakage? 

(c) Compute the DFT if TV = 8 and Fq = 0.25. Has aliasing occurred? Has leakage occurred? 

(d) Compute the DFT if TV = 8 and Fq = 1.25. Has aliasing occurred? Has leakage occurred? 

(e) Compute the DFT if TV = 9 and Fq = 0.2. Has aliasing occurred? Has leakage occurred? 

[Hints and Suggestions: There is no aliasing if Fq < 0.5 and no leakage if k = NFq is an integer.] 

(Spectral Spacing) What is the spectral spacing in the 500-point DFT of a sampled signal obtained 
by sampling an analog signal at 1 kHz? 

[Hints and Suggestions: The spectral spacing equals //.] 

(Spectral Spacing) We wish to sample a signal of 1-s duration, band-limited to 50 Hz, and compute 
the DFT of the sampled signal. 

(a) Using the minimum sampling rate that avoids aliasing, what is the spectral spacing A/, and 
how many samples are acquired? 

(b) How many padding zeros are needed to reduce the spacing to 0.5A/, using the minimum sam¬ 
pling rate to avoid aliasing if we use the DFT? 

(c) How many padding zeros are needed to reduce the spacing to 0.5A/, using the minimum sam¬ 
pling rate to avoid aliasing if we use a radix-2 FFT? 

[Hints and Suggestions: The spectral spacing is jj. To reduce it, increase TV by zero padding.] 

10.22 (Spectral Spacing) We wish to sample the signal x(t) = cos(507rf) + sin(2007rf) at 800 Hz and 
compute the TV-point DFT of the sampled signal x[n]. 

(a) Let TV = 100. At what indices would you expect to see the spectral peaks? Will the peaks occur 
at the frequencies of x(t)l 

(b) Let TV = 128. At what indices would you expect to see the spectral peaks? Will the peaks occur 
at the frequencies of x(t)l 


10.20 


10.21 
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[Hints and Suggestions: Use Fq = to compute k = NFq = Nfo/S. A peak will occur at the 
exact frequency only for integer k.] 

10.23 (Spectral Spacing) We wish to sample the signal x(t) = cos(507rt) + sin(807rf) at 100 Hz and 
compute the TV-point DFT of the sampled signal x[n]. 

(a) Let TV = 100. At what indices would you expect to see the spectral peaks? Will the peaks occur 
at the frequencies of x(t)l 

(b) Let TV = 128. At what indices would you expect to see the spectral peaks? Will the peaks occur 
at the frequencies of x(t)l 

[Hints and Suggestions: Use Fq = ^ to compute k = NFq = Nfo/S. A peak will occur at the 
exact frequency only for integer k.] 

10.24 (Spectral Spacing) We wish to identify the 21-Hz component from the TV-sample DFT of a signal. 
The sampling rate is 100 Hz, and only 128 signal samples are available. 

(a) If TV = 128, will there be a DFT component at 21 Hz? If not, what is the frequency closest to 
21 Hz that can be identified? What DFT index does this correspond to? 

(b) Assuming that all signal samples must be used and zero-padding is allowed, what is the smallest 
value of TV that will result in a DFT component at 21 Hz? How many padding zeros will be 
required? At what DFT index will the 21-Hz component appear? 

[Hints and Suggestions: Use Fq = -| to compute k = NFo = Nfo/S. In (a), the peak will occur 
at the exact frequency only if k is an integer. In (b), pick TV such that k is an integer.] 

10.25 (Sampling Frequency) For each of the following signals, estimate the sampling frequency and 
sampling duration by arbitrarily choosing the bandwidth B as the frequency where |U(/)| is 5% of 
its maximum and the signal duration D as the time at which x(t) is 1% of its maximum. 

(a) x(t) = e~ t u{t ) (b) x(t) = te^uft) (c) x(t) = tri(f) 

[Hints and Suggestions: First, set \X(f)\ = 0.05|X(/)| max to estimate B and S > 2 B. Next, 
estimate the time D at which x(t) is 1% of its peak and find TV = SD (as an integer). Numerical 
estimates give D = 7.64 s for (b) and B « 0.81 Hz for (c).] 

10.26 (Sampling Frequency and Spectral Spacing) It is required to find the DFT of the signal 
x(t) = e _t u(t) after sampling it for a duration D that contains 95% of the total signal energy E. How 
many samples are acquired if the sampling rate S is chosen to ensure that 

(a) The aliasing level at / = O-SA due to the first replica is less than 1% of the peak level? 

(b) The energy in the aliased signal past / = 0.5S 1 is less than 1% of the total signal energy? 

[Hints and Suggestions: Use Parseval’s relation to set 0.951? = f ( ^ e~ 2t dt and estimate D. In (b), 
set \X(f)\f-g /2 = 0.01|A(/)| max to estimate B. In (c), set ff^ 2 l^(/)l 2 ^/ = 0.991? to estimate B. 
Use S > 2b to compute TV = SD (as an integer). Note that E = 0.5 and |A(/)| 2 = 1+4 ^ 2 p ■] 

10.27 (Sampling Rate and the DFT) The pulse u(t) — u(t — 1) is replicated every two seconds to get 
a periodic signal x(t) with period T = 2. The periodic signal is sampled for one full period to obtain 
TV samples. The TV-point DFT of the samples corresponds to the signal y(t) = A + l?sin(7rf). 

(a) What are the possible values of TV for which you could obtain such a result? For each such 
choice, compute the values of A and B. 
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(b) What are the possible values of N for which you could obtain such a result using the radix-2 
FFT? For each such choice, compute the values of A and B. 

(c) Is it possible for y(t) to be identical to x(t) for any choice of sampling rate? 

[Hints and Suggestions: The DFT contains a nonzero sample at k = 0 and a pair of nonzero 
imaginary samples ±j0.5 at the indices ±fc corresponding to /o = 0.5 Hz.] 

10.28 (Sampling Rate and the DFT) A periodic signal x(t) with period T = 2 is sampled for one full 
period to obtain N samples. The signal reconstructed from the fV-point DFT of the samples is y(t). 

(a) Will the DFT show the effects of leakage? 

(b) Let N = 8. How many harmonics of x(t ) can be identified in the DFT? What constraints on 
x(t) will ensure that y(t) = x(t)7 

(c) Let N = 12. How many harmonics of x(t) can be identified in the DFT? What constraints on 
x(t) will ensure that y(t) = x(t)7 

[Hints and Suggestions: The number of useful harmonics is — 1. If y(t) = x(t), the periodic 
signal x(t) must be bandlimited to ^ fo-] 

10.29 (Frequency Resolution) A signal is sampled at 5 kHz to acquire N samples of x[n\. 

(a) Let N = 1000. What is the frequency resolution in the DFT of the sampled signal a;[n]? 

(b) Let N = 1000. What is the frequency resolution in the DFT of the von Hann windowed signal? 

(c) Find the smallest value of N for a frequency resolution of 2 Hz with no window. 

(d) Find the smallest value of N for a frequency resolution of 2 Hz with a von Hann window. 

[Hints and Suggestions: In (a), the frequency resolution is A/ = In (b), it is A/ = where 
C = 2. In (c), N = -£j. In (d), N = £y] 

10.30 (Convolution and the DFT) Consider two sequences x[n] and h[n\ of length 12 samples and 20 
samples, respectively. 

(a) How many padding zeros are needed for x\n] and h\n] in order to find their regular convolution 
y[n], using the DFT? 

(b) If we pad x[n\ with eight zeros and find the periodic convolution y p [n] of the resulting 20-point 
sequence with /i[n], for what indices will the samples of y[n] and y p [n] be identical? 

[Hints and Suggestions: Periodic convolution of sequences of equal length N, requires wraparound 
of the last N— 1 samples of the regular convolution. The last (A r tli sample) in the periodic convolution 
is not contaminated. If the last L samples of the regular convolution are zero, the last L + l samples 
of the periodic convolution are not contaminated.] 

10.31 (FFT) Write out the DFT sequence that corresponds to the following bit-reversed sequences obtained 
using the DIF FFT algorithm. 

(a) {1,2,3,4} (b) {0, -1,2, -3,4, -5,6, -7} 

10.32 (FFT) Set up a flowchart showing all twiddle factors and values at intermediate nodes to compute 
the DFT of x[n\ = {1,2, 2, 2,1,0,0, 0}, using 

(a) The 8-point DIF algorithm. (b) The 8-point DIT algorithm. 
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10.33 (Spectral Spacing and the FFT) We wish to sample a signal of 1-s duration, and band-limited 
to 100 Hz, in order to compute its spectrum. The spectral spacing should not exceed 0.5 Hz. Find 
the minimum number N of samples needed and the actual spectral spacing A/ if we use 

(a) The DFT. (b) The radix-2 FFT. 

[Hints and Suggestions: The spectral spacing is For the FFT, A is a power of 2.] 

4 4 

10.34 (Convolution) Find the linear convolution of x[n} = {1,2,1} and h[n] = {1,2,3}, using 

(a) The time-domain convolution operation. 

(b) The DFT and zero-padding. 

(c) The radix-2 FFT and zero-padding. 

Which of these methods yield identical results and why? 

[Hints and Suggestions: In (a), the convolution length is N = 5. In (b), zero pad each signal to 
N = 5, multiply the DFTs (at each index) and find the 5-point IDFT. In (c), zero-pad to N = 8.] 

4 4 

10.35 (Convolution) Find the periodic convolution of x[n] = {l, 2, 1} and h[n] = {l, 2, 3}, using 

(a) The time-domain convolution operation. 

(b) The DFT operation. Is this result identical to that of part (a)? 

(c) The radix-2 FFT and zero-padding. Is this result identical to that of part (a)? Should it be? 
Which of these methods yield identical results and why? 

[Hints and Suggestions: In (a), use regular convolution and wraparound. In (b), multiply the 
DFTs (at each index) and find the 3-point IDFT. In (c), zero-pad each signal to N = 4, multiply the 
DFTs (at each index) and find the 4-point IDFT.] 

4 

10.36 (Correlation) Find one period (starting at n = 0) of the periodic correlation r x h of x[n] = {i, 2, 1} 

4 

and h[n] = {l, 2, 3}, using 

(a) The time-domain correlation operation. 

(b) The DFT. 

[Hints and Suggestions: In (a), use circular folding and replication to get samples of h[—n] starting 
at the origin, compute x\n\ * h[—n] and wraparound. In (b), multiply the DFTs (at each index) and 
find the 3-point IDFT. In (b), multiply -Xdft[ fe] and H^ FT [k] (at each index) and find the IDFT.] 

4 4 

10.37 (Convolution of Long Signals) Let x[n\ = {l, 2, 1} and h[n] = {l, 2, 1, 3, 2, 2, 3, 0, 1, 0, 2, 2}. 

(a) Find their convolution using the overlap-add method. 

(b) Find their convolution using the overlap-save method. 

(c) Are the results identical to the time-domain convolution of x[n] and h [n]? 

[Hints and Suggestions: In (a), split h[n] into 3-sample segments, find their convolution with x[n], 
shift (by 0, 3, 6 and 9 samples) and add. In (b), generate 5-sample segments from h[n\ with the first 
as {0, 0,1,2,1}, the second as {2,1,3,2,2} etc with a 2 sample overlap in each segment (zero pad the 
last segment to five samples, if required). Find their periodic convolutions with {a;[n],0,0}, discard 
the first 2 samples of each convolution and concatenate (string together).] 
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COMPUTATION AND DESIGN 

10.38 (DFT Properties) Consider the signal x[n] = n + 1, 0 < n < 7. Use Matlab to compute its DFT. 
Confirm the following properties by computing the DFT. 

(a) The DFT of y[n] = x[—n] to confirm the (circular) folding property 

(b) The DFT of f[n] = x[n — 2] to confirm the (circular) shift property 

(c) The DFT of g[n ] = a;[n/2] to confirm the zero-interpolation property 

(d) The DFT of h[n] = {x[n ], x[n]} to confirm the signal-replication property 

(e) The DFT of p[n\ = x[n\ cos(0.5n7r) to confirm the modulation property 

(f) the DFT of r[n] = x 2 [n\ to confirm the multiplication property 

(g) The DFT of s [n] = a:[n]©a;[?i] to confirm the periodic convolution property 

10.39 (IDFT from DFT) Consider the signal x[n] = (1 + j)n, 0 < n < 9. 

(a) Find its DFT X[k\. Find the DFT of the sequence 0.1X[fc]. Does this appear to be related to 
the signal x[n]? 

(b) Find the DFT of the sequence 0.1X*[fc]. Does this appear to be related to a:[n]? 

(c) Use your results to explain how you might find the IDFT of a sequence by using the forward 
DFT algorithm alone. 

10.40 (Resolution) We wish to compute the radix-2 FFT of the signal samples acquired from the signal 
x(t) = Acos(2nfot) +B cos[2n(fo + Af)t], where /o = 100 Hz. The sampling frequency is S = 480Hz. 

(a) Let A = B = 1. What is the smallest number of signal samples N m ; n required for a frequency 
resolution of A/ = 2 Hz if no window is used? How does this change if we wish to use a 
von Hann window? What about a Blackman window? Plot the FFT magnitude for each case 
to confirm your expectations. 

(b) Let A = 1 and B = 0.02. Argue that we cannot obtain a frequency resolution of A/ = 2 Hz if 
no window is used. Plot the FFT magnitude for various lengths to justify your argument. Of 
the Bartlett, Hamming, von Hann, and Blackman windows, which ones can we use to obtain a 
resolution of A/ = 2 Hz? Which one will require the minimum number of samples, and why? 
Plot the FFT magnitude for each applicable window to confirm your expectations. 

10.41 (Convolution) Consider the sequences x[n] = {1,2,1, 2,1} and h[n] = {1,2,3, 3, 5}. 

(a) Find their regular convolution using three methods: the convolution operation; zero-padding 
and the DFT; and zero-padding to length 16 and the DFT. How are the results of each operation 
related? What is the effect of zero-padding? 

(b) Find their periodic convolution using three methods: regular convolution and wraparound; the 
DFT; and zero-padding to length 16 and the DFT. How are the results of each operation related? 
What is the effect of zero-padding? 

10.42 (Convolution) Consider the signals x[n\ = 4(0.5) n , 0 < n < 4, and h[n} = n, 0 < n < 10. 

(a) Find their regular convolution y[n] = x[n\ * h[n\, using the Matlab routine conv. 

(b) Use the FFT and IFFT to obtain the regular convolution, assuming the minimum length N 
(that each sequence must be zero-padded to) for correct results. 

(c) How do the results change if each sequence is zero-padded to length N + 2? 

(d) How do the results change if each sequence is zero-padded to length N — 2? 
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10.43 (FFT of Noisy Data) Sample the sinusoid x(t) = cos(27t/o<) with fo = 8 Hz at S = 64 Hz for 4 s 
to obtain a 256-point sampled signal x[n}. Also generate 256 samples of a uniformly distributed noise 
sequence s[n] with zero mean. 

(a) Display the first 32 samples of x[n]. Can you identify the period from the plot? Compute and 
plot the DFT of x[n}. Does the spectrum match your expectations? 

(b) Generate the noisy signal y[n] = x [n] + s[n] and display the first 32 samples of y[n\. Do you 
detect any periodicity in the data? Compute and plot the DFT of the noisy signal y\n\. Can 
you identify the frequency and magnitude of the periodic component from the spectrum? Do 
they match your expectations? 

(c) Generate the noisy signal z[n] = cc[n]s[n] (by element-wise multiplication) and display the first 
32 samples of z[n}. Do you detect any periodicity in the data? Compute and plot the DFT of the 
noisy signal z[n]. Can you identify the frequency the periodic component from the spectrum? 

10.44 (Filtering a Noisy ECG Signal: I) During recording, an electrocardiogram (ECG) signal, sampled 
at 300 Hz, gets contaminated by 60-Hz hum. Two beats of the original and contaminated signal (600 
samples) are provided on the author’s website as ecgo.mat and ecg.mat. Load these signals into 
Matlab (for example, use the command load ecgo). In an effort to remove the 60-Hz hum, use the 
DFT as a filter to implement the following steps. 

(a) Compute (but do not plot) the 600-point DFT of the contaminated ECG signal. 

(b) By hand, compute the DFT indices that correspond to the 60-Hz signal. 

(c) Zero out the DFT components corresponding the 60-Hz signal. 

(d) Take the IDFT to obtain the filtered ECG and display the original and filtered signal. 

(e) Display the DFT of the original and filtered ECG signal and comment on the differences. 

(f) Is the DFT effective in removing the 60-Hz interference? 

10.45 (Filtering a Noisy ECG Signal: II) Continuing with Problem 16.44, load the original and 
contaminated ECG signal sampled at 300 Hz with 600 samples provided on the author’s website as 
ecgo.mat and ecg.mat (for example, use the command load ecgo). Truncate each signal to 512 
samples. In an effort to remove the 60-Hz hum, use the DFT as a filter to implement the following 
steps. 

(a) Compute (but do not plot) the 512-point DFT of the contaminated ECG signal. 

(b) Compute the DFT indices closest to 60 Hz and zero out the DFT at these indices. 

(c) Take the IDFT to obtain the filtered ECG and display the original and filtered signal. 

(d) Display the DFT of the original and filtered ECG signal and comment on the differences. 

(e) The DFT is not effective in removing the 60-Hz interference. Why? 

(f) From the DFT plots, suggest and implement a method for improving the results (by zeroing 
out a larger portion of the DFT around 60 Hz, for example). 

10.46 (Decoding a Mystery Message) During transmission, a message signal gets contaminated by a 
low-frequency signal and high-frequency noise. The message can be decoded only by displaying it 
in the time domain. The contaminated signal is provided on the author’s website as mysteryl .mat. 
Load this signal into Matlab (use the command load mysteryl). In an effort to decode the message, 
use the DFT as a filter to implement the following steps and determine what the decoded message 
says. 

(a) Display the contaminated signal. Can you “read” the message? 

(b) Take the DFT of the signal to identify the range of the message spectrum. 
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(c) Zero out the DFT component corresponding to the low-frequency signal. 

(d) Zero out the DFT components corresponding to the high-frequency noise. 

(e) Take the IDFT to obtain the filtered signal and display it to decode the message. 

10.47 (Spectrum Estimation) The FFT is extensively used in estimating the spectrum of various signals, 
detecting periodic components buried in noise, or detecting long-term trends. The monthly rainfall 
data, for example, tends to show periodicity (an annual cycle). However, long-term trends may also 
be present due to factors such as deforestation and soil erosion that tend to reduce rainfall amounts 
over time. Such long-term trends are often masked by the periodicity in the data and can be observed 
only if the periodic components are first removed (filtered). 

(a) Generate a signal x[n] = O.Oln + sin(n7r/6), 0 < n < 500, and add some random noise to 
simulate monthly rainfall data. Can you observe any periodicity or long-term trend from a plot 
of the data? 

(b) Find the FFT of the rainfall data. Can you identify the periodic component from the FFT 
magnitude spectrum? 

(c) Design a notch filter to remove the periodic component from the rainfall data. You may identify 
the frequency to be removed from x[n ] (if you have not been able to identify it from the FFT). 
Filter the rainfall data through your filter and plot the filtered data. Do you observe any 
periodicity in the filtered data? Can you detect any long-term trends from the plot? 

(d) To detect the long-term trend, pass the filtered data through a moving average filter. Experiment 
with different lengths. Does averaging of the filtered data reveal the long-term trend? Explain 
how you might go about quantifying the trend. 

10.48 (The FFT as a Filter) We wish to filter out the 60-Hz interference from the signal 

x(t) = cos(1007rf) + cos(1207rf) 

by sampling x(t) at S = 500 Hz and passing the sampled signal x[n ] through a lowpass filter with a 
cutoff frequency of fc = 55 Hz. The iV-point FFT of the filtered signal may be obtained by simply 
zeroing out the FFT X[k] of the sampled signal between the indices M = int (N fc/S) and N — M 
(corresponding to the frequencies between fc and S — fc)- This is entirely equivalent to multiplying 
X[k\ by a filter function H[k\ of the form 

H[k\ = { 1, ( M ones), (N — 2 M — 1 zeros), (M ones) } 

The FFT of the filtered signal equals Y[k] = H[k]X[k], and the filtered signal y[n] is obtained by 
computing its IFFT. 

(a) Start with the smallest value of N you need to resolve the two frequencies and successively 
generate the sampled signal x[n], its FFT X[k\, the filter function H[k\, the FFT Y[k] of the 
filtered signal as Y[k] = H[k]X[k], and its IFFT y [n]. Plot X[k) and Y[k\ on the same plot and 
x[n] and y[n] on the same plot. Is the 60-Hz signal completely blocked? Is the filtering effective? 

(b) Double the value of N several times and, for each case, repeat the computations and plot 
requested in part (a). Is there a noticeable improvement in the filtering? 

(c) The filter described by h[n} = IFFT{i7[fc]} is not very useful because its true frequency response 
H(F) matches the TV-point FFT H[k\ only at N points and varies considerably in between. To 
see this, pick the value of N from part (a), use the Matlab routine freqz to compute the DTFT 
H(F) of h[n] at N points over 0 < F < 1, and superimpose plots of \H(F) \ and JT[A;]|. How does 
H(F) differ from H[k\? Compute H(F) at 4iV points over 0 < F < 1 and superimpose plots 
of \H(F)\ and ff[fc]|. How does H(F ) differ from H[k]1 What is the reason for this difference? 
Can a larger N reduce the differences? If not, how can the differences be minimized? (This 
forms the subject of frequency sampling filters.) 
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10.49 (Band-Limited Interpolation) Consider the band-limited signal x(t) = sin(2007rf). 

(a) Sample x(t) at S = 400 Hz to obtain the sampled signal x[n] with N = 4 samples. Compute and 
plot the DFT X[k] of x[n]. Can you identify the frequency and magnitude from the spectrum? 

(b) Zero-interpolate the signal G[k) = 8A[fc] by inserting 28 zeros about the middle (about index 
k = 0.51V) to obtain the interpolated 32-point spectrum Y[k]. Compute the IDFT of Y[k] to 
obtain the signal y[n\. Sample x(t) again, but at 8 S Hz, to obtain the sampled signal yi[n\. 
Plot e[n\ = y[n] — yi[n]. Are y[n] and yi[n] identical (to within machine roundoff)? Should they 
be? 

(c) Sample x(t) at S = 800 Hz to obtain the sampled signal x[n] with N = 4 samples. Compute its 
DFT X[k\ and zero-interpolate the signal G[k ] = 8X[fc] by inserting 28 zeros about the middle 
(about index k = 0.51V) to obtain the interpolated 32-point spectrum Y[k]. Compute the IDFT 
of Y[k] to obtain the signal y[n]. Sample x(t) again, but at 85 Hz, to obtain the sampled signal 
yi[n]. Plot e[n] = y[n\ — yi[n\. Are y[n\ and y\[n] identical? Should they be? 

(d) Explain the differences in the results of parts (a) and (b). 

10.50 (Decimation) To decimate a signal x[n] by N, we use a lowpass filter (to band-limit the signal 
to F = 0.5/1V), followed by a down-sampler (that retains only every IVth sample). In this problem, 
ignore the lowpass filter. 

(a) Generate the test signal x[n ] = cos(0.2n7r) + cos(0.3n7r), 0 < n < 59. Plot its DFT. Can you 
identify the frequencies present? 

(b) Decimate x[n) by IV = 2 to obtain the signal ^[n]. Is the signal x[n ] sufficiently band-limited 
in this case? Plot the DFT of X'i [n]. Can you identify the frequencies present? Do the results 
match your expectations? Would you be able to recover x[?r] from band-limited interpolation 
(by IV = 2) of X 2 [n]? 

(c) Decimate x[n] by N = 4 to obtain the signal X 4 [n\. Is the signal x[n ] sufficiently band-limited in 
this case? Plot the DFT of X 4 [n ]. Can you identify the frequencies present? If not, explain how 
the result differs from that of part (b). Would you be able to recover x [n] from band-limited 
interpolation (by N = 4) of aqfn]? 

10.51 (DFT of Large Data Sets) The DFT of a large iV-point data set may be obtained from the DFT 
of smaller subsets of the data. In particular, if N = RC, we arrange the data as an R x C matrix 
(by filling along columns), find the DFT of each row, multiply each result at the location (r, c) by 
W rc = e ~^ 2 ' Krc / N , where r = 0,1,..., R — 1 and c= 0,1,..., C — 1, find the DFT of each column, and 
reshape the result (by rows) into the required IV-point DFT. Let x[n ] = n + 1, 0 < n < 11. 

(a) Find the DFT of x[n] by using this method with R = 3, C = 4. 

(b) Find the DFT of x[n] by using this method with R = 4, C = 3. 

(c) Find the DFT of x\n] using the Matlab command fft. 

(d) Do all methods yield identical results? Can you justify your answer? 

10.52 (Time-Frequency Plots) This problem deals with time-frequency plots of a sum of sinusoids. 

(a) Generate 600 samples of the signal x[n] = cos(0.1n7r) + cos(0.4?r7r) + cos(0.7n7r), the sum of 
three pure cosines at F = 0.05, 0.2, 0.35. Use the Matlab command fft to plot its DFT 
magnitude. Use the Matlab based routine timef req (from the author’s website) to display its 
time-frequency plot. What do the plots reveal? 

(b) Generate 200 samples each of the three signals yi[n] = cos(0.1n7r), 2 / 2 N = cos(0.4n7r), and 
2 / 3 M = cos(0.7n7r). Concatenate them to form the 600-sample signal y[?r] = |j/i[n], y- 2 [n], 2 / 3 [?r]}• 
Plot its DFT magnitude and display its time-frequency plot. What do the plots reveal? 
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(c) Compare the DFT magnitude and time-frequency plots of x[n\ and y[n\ How do they differ? 

10.53 (Deconvolution) The FFT is a useful tool for deconvolution. Given an input signal x[n] and the 
system response y[n], the system impulse response h[n] may be found from the IDFT of the ratio 
-Hdft^’] = 5A>ft[/ c]/AT dft[ fc]• Let x[n] = {1, 2, 3, 4} and h[n] = {1, 2, 3}. 

(a) Obtain the convolution y[n\ = x[n] * h,[n\. Now zero-pad x [n] to the length of y[n] and find the 
DFT of the two sequences and their ratio F?dft [&] • Does the IDFT of iFoFT[fc] equal h[n] (to 
within machine roundoff)? Should it? 

(b) Repeat part (a) with x[ri\ = {1, 2, 3, 4} and h[n] = {1, 2, —3}. Does the method work for 
this choice? Does the IDFT of L?DFT[fc] equal h[n] (to within machine roundoff)? 

(c) Repeat part (a) with x[ri\ = {1, 2, —3} and h[n) = {1, 2, 3, 4}. Show that the method does 
not work because the division yields infinite or indeterminate results (such as g or jj). Does the 
method work if you replace zeros by very small quantities (for example, ICC 10 )? Should it? 

10.54 (FFT of Two Real Signals in One Step) Show that it is possible to find the FFT of two real 
sequences x[n] and y[n\ from a single FFT operation on the complex signal g[n] = x[n] + jy[n\ as 

A D ft[&] = 0.5(G FFT [?V — k] + GoftI^]) ^dft[&] = j'0.5(Gd FT [./V — k] — Goft^’]) 

Use this result to find the FFT of x[n] = {1,2,3,4} and y[n] = {5,6,7, 8} and compare the results 
with their FFT computed individually. 

10.55 (Quantization Error) Quantization leads to noisy spectra. Its effects can be studied only in 
statistical terms. Let x(t) = cos(207rf) be sampled at 50 Hz to obtain the 256-point sampled signal 
x [?r]. 

(a) Plot the linear and decibel magnitude of the DFT of x[n\. 

(b) Quantize x[n ] by rounding to B bits to generate the quantized signal y[n\. Plot the linear 
and decibel magnitude of the DFT of y [n]. Compare the DFT spectra of x[n] and y[n\ for 
B = 8, 4, 2, and 1. What is the effect of decreasing the number of bits on the DFT spectrum 
of y[n}7 

(c) Repeat parts (a) and (b), using quantization by truncation. How do the spectra differ in this 
case? 

(d) Repeat parts (a)-(c) after windowing x [n] by a von Hann window. What is the effect of win¬ 
dowing? 

10.56 (Sampling Jitter) During the sampling operation, the phase noise on the sampling clock can result 
in jitter, or random variations in the time of occurrence of the true sampling instant. Jitter leads 
to a noisy spectral and its effects can be studied only in statistical terms. Consider the analog signal 
x(t) = cos( 27r/ 0 f) sampled at a rate S that equals three times the Nyquist rate. 

(a) Generate a time array t n of 256 samples at intervals of t s = 1/S. Generate the sampled signal 
x[n] from values of x(t) at the time instants in t n . Plot the DFT magnitude of x[n}. 

(b) Add some uniformly distributed random noise with a mean of zero and a noise amplitude of 
At s to t n to form the new time array t nn . Generate the sampled signal y[n] from values of 
x(t) at the time instants in t nn . Plot the DFT magnitude of y[n\ and compare with the DFT 
magnitude of x[n] for A = 0.01, 0.1, 1, 10. What is the effect of increasing the noise amplitude 
on the DFT spectrum of yin]? What is the largest value of A for which you can still identify 
the signal frequency from the DFT of y[n]? 

(c) Repeat parts (a) and (b) after windowing x[n] and y[n] by a von Hann window. What is the 
effect of windowing? 


©Ashok Ambardar, September 1, 2003 




Appendix A 


USEFUL CONCEPTS FROM 

ANALOG THEORY 


A.O Scope and Objectives 

This appendix collects useful concepts and results from the area of analog signals and systems that are 
relevant to the study of digital signal processing. It includes short descriptions of signals and systems, 
convolution, Fourier series, Fourier transforms, Laplace transforms and analog filters. The material presented 
in this appendix should lead to a better understanding of some of the techniques of digital signal processing 
described in the text. 


A.l Signals 

An analog signal x(t) is a continuous function of the time variable t. The signal energy is defined as 


E = 


Pi(t) dt 



\x(t,)\ 2 dt 


(A.l) 


The absolute value |x(t)| is required only for complex-valued signals. Signals of finite duration and amplitude 
have finite energy. 

A periodic signal x p (t) is characterized by several measures. Its duty ratio equals the ratio of its pulse 
width and period. Its average value x av equals the average area per period. Its signal power P equals the 
average energy per period. Its rms value x rms equals y/P. 

x av =^ j x(t) dt P=^J \x(t)\ 2 dt Xims = VP (A.2) 

Signal Operations and Symmetry 

A time shift displaces a signal x(t) in time without changing its shape. The signal y(t) = x(t — a) is a 
delayed (shifted right by a) replica of x(t). A time scaling results in signal compression or stretching. 
The signal f(t) = x(2t) describes a two-fold compression, g{t) = x(t/2) describes a two-fold stretching, and 
p(t) = x(—t) describes a reflection about the vertical axis. Shifting or folding a signal x(t) will not change 
its area or energy, but time scaling x(t) to x(at ) will reduce both its area and energy by |a|. 

A signal possesses even symmetry if x(t) = x(—t), and odd symmetry if x(t) = —x(—t). The area of 
an odd symmetric signal is always zero. 
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Sinusoids and Complex Harmonics 

An analog sinusoid or harmonic signal is always periodic and unique for any choice of period or frequency. 
For the sinusoid x p (t) = Acos(iv 0 t + 9) = Acos[w 0 (^ — t p )\, the quantity t p = —O/uiq is called the phase 
delay and describes the time delay in the signal caused by a phase shift of 0. The various time and frequency 
measures are related by 


fo = ^ uj 0 =y = 2lr fo e = w o t p = 2 nf 0 t p = 2tt^ (A.3) 

If x{t) = Acos(27r/ o f + 0), then P = 0.5A 2 and cc rms = A\f2 — 0.707A If x{t) = Ae ± ^ 2 ' K f° t+e \ then P = A 2 . 
The common period or time period T of a combination of sinusoids is given by the LCM (least common 
multiple) of the individual periods. The fundamental frequency fo is the reciprocal of T and also equals 
the GCD (greatest common divisor) of the individual frequencies. For a combination of sinusoids at different 
frequencies, say y[t) = x\(t) + X 2 (t) + ■ • -, the signal power P y equals the sum of the individual powers and 
the rms value equals \/~Py 

Useful Signals 

The unit step u(t), unit ramp r(t ), and signum function sgn(t) are piecewise linear. The unit step is 
discontinuous at t = 0, where its value is undefined (sometimes chosen as 0.5). The value of the signum 
function is also undefined at t = 0 and chosen as zero. The unit ramp may also be written as r(t) = tuft). 


| REVIEW PANEL A.l 
The Step, Ramp, and Signum Functions Are Piecewise Linear 

1 


1 

1 

sgn (t) 


t 


-1 


r(t) 


The rectangular pulse rect(t) and triangular pulse tri(f) are even symmetric and possess unit area and 
unit height as shown in the following review panel. The signal /(<) = rect(^A^) is a rectangular pulse of 
width a, centered at t = (3. The signal g(t) = tri(^)A) is a triangular pulse of width 2a centered at t = (3. 


REVIEW PANEL A.2 

The Signals rect(f) and tri(t) Have Even Symmetry, Unit Area, and Unit Height 



uectfd i 
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EXAMPLE A.l (Signal Representation) 

Consider the following signals 
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f(t) = u(l-t), g(X) = u(t - A) (vs. A), x(t) = rect[0.5(f — 1)], y(t) = tri[|(t - 1)] 

These signals are sketched as follows: 

The signal f(t) = u(l — t) is a folded step, delayed by 1 unit. 

The signal g( A) = u(t — A) versus A is a folded step, shifted t units to the right. Pay particular attention to 
this form, which will rear its head again when we study convolution. 

The signal x(t) = rect[0.5(f — 1)] is a stretched rectangular pulse (of width 2 units) delayed by (or centered 
at) 1 unit. It may also be expressed as x(t) = u(t) — u(t — 2). 

The signal y(t) = tri[ ’ (t — 1)] is a stretched triangular pulse (of width 6 units) delayed by (or centered at) 
1 unit. We may also write y(t) = | [r(t + 2) — r(t — 1) + r(t — 4)] 



ll( 1 

-t) 

u(t- 

-X) 

\x(t) 


Yy(t) 

1 


1 


1 


1 










t 


X 



1 \=*. 
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Figure EA.l The signals for Example A.l 


The Sine Function 

The sine function sinc(f), shown in Figure A.l is defined as 

. . sin(7rf) , . 

smc(t) = - (A.4) 

7rf 

It is an even symmetric function with unit area. It has unit height at the origin, zero crossings, which 
occur at t = ±1, ±2, ±3,..., a central mainlobe between the first zero on either side of the origin and 
progressively decaying negative and positive sidelobes. The minimum peak equals —0.2178, and the next 
positive peak equals 0.1284. The signal sinc 2 (f) also has unit area with zeros at unit intervals but is entirely 
positive. The area of any sine or sine-squared function equals the area of the triangle inscribed within its 
central lobe as shown. 



- 3 - 2-10123 

Time t [seconds] 


Figure A.l The sine function and the sine-squared function 
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The Impulse Function 

The unit impulse is a tall, narrow spike with unit area defined by 

The function AS(t) is shown as an arrow with its area (or strength) A labeled next to the tip. For visual 
appeal, we make its height proportional to A. Signals such as the rect pulse ^ rect (t/r), tri pulse 1 tri(t/r), 
the exponential ^e~ t d T u(t), and the sine 1 sine (t/r) all possess unit area, and give rise to the unit impulse 
6 (t) as r —> 0. The unit impulse S(t) may also be regarded as the derivative of u(t). 

S(t) = -— u(t) = [ 5(t) dt 
dt oo 

Three useful properties of the impulse function relate to scaling, products and sifting. 

Scaling Product Sifting 

= rr 

\a\ 

Time-scaling implies that since S(t) has unit area, 6 (at), its compressed version, has an area of j^. The 
product property says that an arbitrary signal x(t) multiplied by the impulse S(t — a) is still an impulse 
(whose strength equals x(a). The sifting property says that the area of the product x(t)S(t — a) is just x(a). 


m 


x(t)5(t — a) = x(a)S(t — a) 


x(t)6(t — a) dt = x(a) 



EXAMPLE A.2 (Properties of the Impulse Function) 

(a) Consider the signal x(t) = 2r(t) — 2r(t — 2) — Au(t — 3). Sketch x(t), f(t) = x(t)6(t— 1), and g(t) = x'(t). 


/ OO 

x(t)5(t — 2) dt. 

-OO 

Refer to the figure for the sketches. 



x(t) 8 (t -1) 

(2) A 


kx'(t) 


3 t 


(-4)i 


Figure EA.2A The signals for Example A. 2 (a) 


From the product property, f(t) = x(t)S(t — 1) = x(l)5(t — 1). This is an impulse function with 
strength x(l) =2. 

The derivative g(t) = x'(t) includes the ordinary derivative (slopes) of x(t) and an impulse function of 
strength —4 at t = 3. 

/ OO 

x(t)S(t — 2) dt = x(2) = 4. 

-OO 


nOO 

(b) Evaluate / = / At 2 5(t — 3) dt. 

Jo 


Using the sifting property, we get I = 4(3) 2 = 36. 
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Signal Approximation by Impulses 

A signal x(t) multiplied by a periodic unit impulse train with period t s yields the ideally sampled signal, 
as shown in Figure A.2. The ideally sampled signal is an impulse train described by 

OO OO 

xi(t) = x(t) 6(t — kt s ) = x(kt s )S(t — kt s ) (A.5) 

k ——oo k ——oc 

Note that xi(t) is non-periodic and the strength of each impulse equals the signal value x(kt s ). This form 
actually provides a link between analog and digital signals. 


Section signal into narrow rectangular strips 


Replace each strip by an impulse 


tit , 


h t s 

Figure A.2 Signal approximation by impulses 


Moments 

Moments are general measures of signal “size” based on area and are defined as shown. 


nth moment 


m„ 



t n x(t) dt 


Mean 

m x (mean) = 


in i 
m 0 


Central moment 



m x ) n x{t) dt 


The zeroth moment mo = / x(t) dt is the area of x(t). The normalized first moment m x = mi/mo is the 
mean. Moments about the mean are called central moments. The second central moment fj , 2 is called the 
variance. It is denoted a 2 and its square root a is called the standard deviation. 


M2 = er 2 


m 2 

-m 

m 0 


2 

X 


(A.6) 


A.2 System Analysis 

Analog LTI (linear, time-invariant) systems may be described by differential equations with constant coeffi¬ 
cients. An ?rth-order differential has the general form 


2 / (n) (f) + ai7/ (n - Va n _ 1 y {1 \t) + a n y{t) = b 0 x {m \t) + b 1 x (m -b& m _i:r (1) (f) + & m :r(f) (A.7) 

To solve for the output y(t) for t > 0, we require the n initial conditions y( 0), y (1 ^(0),... ,y( n ~ 1 \ 0) (the 
response and its n — 1 successive derivatives at t = 0). A convenient technique for solving a linear constant- 
coefficient differential equation (LCCDE) is the method of undetermined coefficients, which yields the 
total response as the sum of the forced response tjF(t) and the natural response j/jy(t). 

The forced response is determined by the input terms (left-hand side of the differential equation) and 
has the same form as the input as summarized in Table A.l. The constants are found by satisfying the given 
differential equation. 
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Table A.l Form of the Forced Response for Analog LTI Systems 


Note: If the right-hand side (RHS) is e at , where a is also a root of the characteristic 
equation repeated r times, the forced response form must be multiplied by t r . 

Entry 

Forcing Function (RHS) 

Form of Forced Response 

1 

Cq (constant) 

Ci (another constant) 

2 

e at (see note above) 

Ce at 

3 

cos (cut + (3) 

C i cos(wf) + C 2 sin(wf) or C cos (cot + 9) 

4 

e at cos (cot + (3) (see note above) 

e at [Ci cos (cot) + C 2 sin(wt)] 

5 

t 

C 0 + Cii 

6 

te at (see note above) 

e“ 4 (Co + Ci<) 


Table A.2 Form of the Natural Response for Analog LTI Systems 


Entry 

Root of Characteristic Equation 

Form of Natural Response 

1 

Real and distinct: r 

Ke rt 

2 

Complex conjugate: (3 ± ju> 

e^lKi cos (cot) + K 2 sin(wt)] 

3 

Real, repeated: r p+1 

e rt (K 0 + Kit + K 2 t 2 + • • • + K p tP) 

4 

Complex, repeated: (/3 ± j(x) p+1 

gflt -|- Alt + ^2^ + • • • + A p t p ) 

+ eP f sin(u>t)(B 0 + Bit + B 2 t 2 H-+ B p t p ) 


The form of the natural response depends only on the system details and is independent of the nature 
of the input. It is a sum of exponentials whose exponents are the roots (real or complex) of the so-called 
characteristic equation or characteristic polynomial defined by 

(ios n + a lS n 1 + a,2S n 2 + • • • + a n -2S 2 + a n _i s + a n = 0 (A.8) 

Its n roots, Si, S 2 , ■ ■ ■, s ni define the form of the natural response as summarized in Table A.2. The constants 
are evaluated after setting up the total response ) using the specified initial conditions. 


EXAMPLE A.3 (Natural and Forced Response) 

Consider the first-order system y'(t) + 2 y(t) = x{t). Find its response if 

(a) x(t) = 6, y(0) = 8 (b) x(t) = cos(2 1), y( 0) = 2 (c) x(t) = e~ 2t , y(0) = 3 

The characteristic equation s + 2 = 0 has the root s = —2. 

The natural response is thus f/jv(f) = Ke~ 2t . 
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(a) Since x(t) = 6 is a constant, we choose 2 /f(0 = C. 

Then y' F {t) = 0 and y' F {t) + 2 y F (t) = 2 C = 6, and thus 2 /f(0 = C = 3. 

The total response is y(t) = 2//v(0 + 2/f(0 = Ke~ 2t + 3. 

With y(0) = 8, we find 8 = K + 3 (or K = 5) and y(t) = 5e _2t + 3, t > 0 or y(t) = (5e -2 * + 3 )u(t). 

(b) Since x(t) = cos(2 t), we choose 2 Af( 0 = Acos(2t) + £?sin(2f). 

Then y' F (t) = —2Asin(2t) + 2£?cos(2f), and 

2/^(t) + 2y F (t) = (2A + 2R)cos(2f) + (2B — 2A)sin(2f) = cos(2t). 

Comparing the coefficients of the sine and cosine terms on either side, we obtain 
2A + 2B =1, 2B - 2A = 0 or A = 0.25, B = 0.25. This gives 
yp’(t) = 0.25cos(2t) + 0.25sin(2t). 

The total response is y(t) = yN(t) + yp(t) = Ke~ 2t + 0.25cos(2t) + 0.25sin(2t). 

With ?/(0) = 2, we find 2 = K + 0.25 (or K = 1.75) and 

y(t) = [1.75e- 2t + 0.25 cos(2<) +0.25 sin(2t)]u(<) 

The steady-state response is y ss (t) = 0.25cos(2t) + 0.25sin(2<), a sinusoid at the input frequency. 

(c) Since x(t) = e~ 2t has the same form as yN{t), we must choose yp(t) = Cte~ 2t . 

Then y F (t) = Ce~ 2t — 2 Cte~ 2t , and y' F (t) + 2y F (t) = Ce~ 2t — 2 Cte~ 2t + 2Cte~ 2t = e~ 2t . 

This gives C = 1, and thus yp(t) = te~ 2t and y(t) = yN(t) + yp{t) = Ke~ 2t + te~ 2t . 

With 2/(0) = 3, we find 3 = K + 0 and y(t) = (3e _2t + te~ 2t )u{t). 


A.2.1 The Zero-State Response and Zero-Input Response 

It is often more convenient to describe the response y(t) of an LTI system as the sum of its zero-state 
response (ZSR) y zs (t) (assuming zero initial conditions) and zero-input response (ZIR) y zl (t) (assuming zero 
input). Each component is found using the method of undetermined coefficients. Note that the natural and 
forced components 2//v(t) and 2 /f(£) do not, in general, correspond to the zero-input and zero-state response, 
respectively, even though each pair adds up to the total response. 


EXAMPLE A.4 (Zero-Input and Zero-State Response for the Single-Input Case) 

Let y"(t) + 3//(f) + 2 y(t) = x(t) with x(t) = 4e -3t and initial conditions 2/(0) = 3 and y'{ 0) = 4. 
Find its zero-input response and zero-state response. 

The characteristic equation is s 2 + 3s + 2 = 0 with roots Si = —1 and S 2 = —2. 

Its natural response is 2/jv(t) = K\e Slt + A' 2 e S2 ‘ = Kie~ l + K 2 e~ 2t . 

1. The zero-input response is found from 2 /at(<) and the prescribed initial conditions: 

2 <te(t) = X ie - 4 + K 2 e~ 2t 2/zi(0) = K\ + I< 2 = 3 y'^Q) = -K, - 2 K 2 = 4 


This yields K 2 = —7, A'i = 10, and y z i(t) = lOe * — 7e 2t . 
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2. Similarly, y zs (t) is found from the general form of y(t) but with zero initial conditions. 

Since x(t) = 4e _3t , we select the forced response as yF(t) = Ce~ 3t . 

Then, y' F (t) = —3 Ce~ 3t , y F (t ) = 9Ce _3t , and y F (t) + 3y' F (t) + 2y F (t) = (9C— 9C+ 2C)e~ 3t = 4e~ 3t . 
Thus, C = 2, yp(t) = 2e~ 3t , and y zs (t) = Ade _t + K 2 e~ 2t + 2e~ 3t . 

With zero initial conditions, we obtain 

y zs ( 0) = K\ + I<-2 + 2 = 0 y' zs ( 0) = -Ad - 2K 2 - 6 = 0 

This yields K 2 = —4, Ad = 2, and y zs (t) = 2e -t — 4e _2t + 2e~ 3t . 

3. The total response is the sum of y zs (t) and y z \{t)-. 

y(t) = y z i(t) + y zs (t) = 12e _t - lle _2t + 2e~ 3t , t > 0 


A.2.2 Step Response and Impulse Response 

The step response, s(t) is the response of a relaxed LTI system to a unit step u(t). The impulse response 
h(t) is the response to a unit impulse 6(t) and also equals s'(t). The differential equation for the RC lowpass 
filter sketched in the following review panel is 

y’(t) + -y(t ) = -x(t) (A.9) 

r r 

where r = RC defines the time constant. The characteristic equation s+ - = 0 yields the natural response 
yjv(t) = Ae -t / T . To find the step response, we let x{t) = u(t) = 1, t > 0. So the forced response, yF(t) = B, 
is a constant. Then, with y' F {t ) = 0, we obtain 

y' F (t) +-yF(t) = - = 0 + B or B = 1 

T T 

Thus, y(t) = ) + yjv(i) = 1 + Ae _t / T . With y( 0) = 0, we get 0 = 1 + K and 

s (t) = y(t) = (1 — e _t ^ r )w(t) (step response) (A.10) 

The impulse response hit) equals the derivative of the step response. Thus, 

hit) = s'it) = -e _t ^ T M(t) (impulse response) (A.11) 

r 


REVIEW PANEL A.3 


Unit Step Response and Unit Impulse Response of an RC Lowpass Filter 

The output is the capacitor voltage. The time constant is r = RC. 



Ad) 



Step response: s(t) — (1 — e t ^ T )u(t) 


Impulse response: h(t) = s'(t) = -e t ^ T u(t) 
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A. 3 Convolution 

Convolution finds the zero-state response y(t) of an LTI system to an input x(t) and is defined by 

/ OO 

x(X)h(t — A) dX (A.12) 

-OO 

The shorthand notation x(t) * h(t) describes the convolution of the signals x(t ) and h(t). 


Useful Convolution Properties 

The starting time of the convolution equals the sum of the starting times of x(t) and h{t). The ending time 
of the convolution equals the sum of the ending times of x(t) and h(t). The convolution duration equals the 
sum of the durations of x(t) and h(t). The area of the convolution equals the product of the areas of x(t) 
and h{i). The convolution of an odd symmetric and an even symmetric signal is odd symmetric, whereas 
the convolution of two even symmetric (or two odd symmetric) signals is even symmetric. Interestingly, 
the convolution of x{i) with its folded version x(—t) is also even symmetric, with a maximum at t = 0. 
The convolution x(t) *x(—t) is called the autocorrelation of x(t). The convolution of a large number of 
functions approaches a Gaussian form. This is the central limit theorem. 

A.3.1 Useful Convolution Results 

The convolution of any signal x{i) with the impulse S(t) reproduces the signal x(t). If the impulse is shifted, 
so is convolution. 

x(t) * S(t) = x(t) x(t) * S(t — a) = x{t — a) 

Other useful convolution results are illustrated in Figure A.3. By way of an example, 

/ OO pt 

e- aX e- a{t - x) u(X)u{ t - X) dX = e~ at dX = te~ at u(t) 

-oo J 0 


A.4 The Laplace Transform 

The Laplace transform A(s) of a causal signal x(t) is defined as 



(A.13) 


The complex quantity s = a + jto generalizes the concept of frequency to the complex domain. Some useful 
transform pairs and properties are listed in Table A.3 and Table A.4. 


A.4.1 The Inverse Laplace Transform 

The inverse transform of H(s) may be found by resorting to partial fraction expansion and a table look-up. If 
H(s ) = P(s)/Q(s), the form of the expansion depends on the nature of the factors in Q(s) and summarized 
below. Once the partial fraction expansion is established, the inverse transform for each term can be found 
with the help of Table A.5. 
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Table A.3 A Short Table of Laplace Transforms 


Entry 

x{t.) 

X(s) 

Entry 

x{t) 

X{s) 

1 

m 

1 

2 

u(t) 

1 

s 

3 

e~ at u(t) 

1 

A 

e~ at sin (/3t)u(t) 

p 

s + a 


(s + a) 2 + (3 2 

5 

te~ at u{t) 

I 

6 

e~ at cos {pt)u{t) 

s + a 

(s + a) 2 

(s + a) 2 + P 2 

7 

cos (/3t)u(t) 

s 

8 

sin {(3t)u{t) 


s 2 + P 2 

S 2 + p 2 


Table A. 4 Operational Properties of the Laplace Transform 


Note: x(t) is to be regarded as the causal signal x(t)u(t). 

Entry 

Property 

x(t) 

X(s) 

1 

Superposition 

axi(t) + Px 2 {i) 

o^l(s) + (3X2^S ) 

2 

Times-exp 

e~ at x(t) 

X (5 -|- ct) 

3 

Time Scaling 

x{at ), a > 0 

-x(-) 

4 

Time Shift 

x(t — a)u(t — a), a > 0 

e~ as X(s) 

5 

Times-f 

tx{t) 

dX(s) 

ds 

6 

Derivative 

x'(t ) 

sX(s) — x(0—) 

7 


a:(")(*) 

s"A(s) - s n_1 a:(0—)-a:"" 1 ^-) 

8 

Convolution 

x(t) * h(t) 

X(s)H(s) 
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Figure A.3 The convolution of some useful signals 


| REVIEW PANEL A.4 | 

Inverse Transformation of A(s) Relies on Partial Fractions and Table Look-Up 

N K N Pis) 

Distinct roots: X(s) = TT -— = -, where K m = (s + p m )X(s)| 

S+Pm “,S + Pm « Prr 

m =1 m =1 

AT N k -1 n 

Repeated: -— TT — Krn \-X^ -— A n = [(s + r) k X(s)] 

(s + r) k s + Pm ' s + Pm ' (s + r) k ~ n n\ ds n 


(s + r) k J-l s -\-p r1 

m =1 


E K m 

•S -I- < 


^s+Pm ^— / {s + r) k 

m= 1 n=0 


Table A.5 Inverse Laplace Transforms of Partial Fraction Expansion Terms 

Entry Partial Fraction Expansion Term Inverse Transform 


Ke~ at u{t) 


(s + a) n 

Cs + D 
(s + a) 2 + /3 2 

MLO Ml -6 
s + a + j/3 s T a — j/3 


(n-1)! 


t n-l e -at u ^ 


e at C cos(fit) + — —-^-sin (/3t) u(t) 

H 

2 M e~ at cos (fit — 0)u(t ) 
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EXAMPLE A.5 (Partial Fraction Expansion) 

2 S 3 -)- + 4s + S 

(a) (Non-Repeated Poles) Let X(s) = —-——-This can be factored as 

s(s + l)(s 2 + 4s + 8) 


A 


A* 


X ( ) = ^ + -^ + _ _ 

s s + 1 s + 2 + j2 _l ~s + 2 — j 2 


We successively evaluate 
Kx = sX(s) 


2s 3 + 8s“ T 4s T ! 


s =o (s + 1) (s 2 + 4s + 8) 




s=0 


I < 2 = (s + l)X(s) 


2s 3 + 8s 2 + 4s + 8 


I S—— 1 

A = (s + 2 + j2)X(s) 


s —— i —5 


s(s 2 + 4s + 8) 

2s 3 + 8s 2 + 4s + 8 

s—~ 2 -j 2 s(s + l)(s + 2 — j 2 ) I s=— 2 —j 2 

The partial fraction expansion thus becomes 

, 1 2 1.5 + j0.5 1.5 — j0.5 

* (s) ^ _ ITT + S + 2 + J2 + s + 2 — j 2 

With 1.5 + j0.5 = 1.581Z18.4 0 = 1.581Z0.1024 tt = MZ6>, we find x(t) as 

x(t) = u{t) — 2e~ t u(t) + 3.162e -2 * cos(2 1, — 0.10247r)w(t) 


= 1.5 + j'0.5 


(b) (Repeated Poles) Let X(s) = 


(s + l)(s + 2) 3 


. Its partial fraction expansion is 


A-i 


A 9 


, . Ai A 0 

[S) = JTl + (s + 2) 3 + (s + 2) 2 + (J+2) 


We compute Ki = (s + l)X(s) 
4 


= 4. 


Since (s + 2) 3 A(s) = 


s + 1 


=-i (s + 2) 3 1 
, we also successively compute 


This gives the result 


We then find x(t) = 


A 0 — 
A\ = 
A 2 = 


A(s) 
4e _t u(<) — 21 



-4 


d 

A 

4 

ds 

_s + 1 

s=—2 (s+1) 2 



4 

4 

2 ds 2 

s + 1 

s ——2 (s+1) 3 


4 4 4 4 

“ s + 1 _ (s + 2) 3 ~~ (s + 2) 2 ~ s + 2 
2 e~ 2 t u(t) — Ate~ 2 t u{t) — Ae~ 2 t u{t). 


A 

-A 
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A.4.2 Interconnected Systems 

The impulse response h(t) of cascaded LTI systems is the convolution of the individual impulse responses.The 
impulse response of systems in parallel equals the sum of the individual impulse responses. 

he it) = hi(t) * / 12 (f) * ■ ■ ■ *hisr(t) (cascade) hp(t) = h\{t) + / 12 (f) + • ■ ■ + hN(t) (parallel) 

The overall transfer function of cascaded systems is the product of the individual transfer functions (assuming 
ideal cascading and no loading effects). The overall transfer function of systems in parallel is the algebraic 
sum of the individual transfer functions. 

Hc(s) = Hi(s)H 2 (s) ■ ■ ■ Hn(s) (cascade) Hp(s) = Hi(s) + H 2 (s) + ■ ■ ■ + Hn(s) (parallel) 


A.4.3 Stability 

In the time domain, BIBO (bounded-input, bounded-output) stability of an LTI system requires a differential 
equation in which the highest derivative of the input never exceeds the highest derivative of the output and 
a characteristic equation whose roots have negative real parts. Equivalently, we require the impulse response 
h(t) to be absolutely integrable. In the s-domain, we require a proper transfer function H(s ) (with common 
factors canceled) whose poles lie in the left half of the s-plane (excluding the jee-axis). 


REVIEW PANEL A.5 

BIBO Stability from the Transfer Function or Impulse Response 

From transfer function: H(s ) must be strictly proper and its poles must lie inside the LHP. 

From impulse response: h(t) must be absolutely integrable (f |/i(A)| dX < oo). 


Minimum-Phase Filters 

A minimum-phase system has all its poles and zeros in the left half-plane of the s-plane. It has the smallest 
group delay and smallest deviation from zero phase, at every frequency, among all transfer functions with 
the same magnitude spectrum |if(o;)|. 

A.4.4 The Laplace Transform and System Analysis 

The Laplace transform is a useful tool for the analysis of LTI systems. To find the zero state response of 
an electric circuit, we transform a circuit to the s-domain by replacing the elements R , L, and C by their 
impedances Zp, Zp, and Zc and replacing sources by their Laplace transforms. We may also transform the 
system differential equation. For a relaxed LTI system, the zero-state response V(s) to an input X(s) is 
H(s)X(s). If the system is not relaxed, the effect of initial conditions is easy to include. 


EXAMPLE A.6 (Solving Differential Equations) 

Let y"(t) + 3y'(t) + 2y(t) = 4e -2i , with y(0) = 3 and y'(0) = 4. 

Transformation to the s-domain, using the derivative property, yields 

s 2 F(s) - sy(0) - y'{ 0) + 3[sF(s) - 2/(0)] + 2 Y(s) = 
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(a) (Total Response) Substitute for the initial conditions and rearrange: 

/ 2 . 4 3s“ + 19s T 30 

(s + 3s + 2 )Y (s) = 3s + 4 + 9 H -— = -— - 

s+2 s+2 

Upon simplification, we obtain Y (s) and its partial fraction form as 

3s 2 + 19s+ 30 Ad A 0 A 1 


Y(a) = 


(s + l)(s + 2) 2 s + 1 (s + 2) 2 s + 2 
Solving for the constants, we obtain 

3s 2 + 19s+ 30 I 


I<i = 


An — 


(s + 2) 2 
3s 2 + 19s + 30 


= 14 


S — — 1 


, d 

1 ds 


s + 1 

3s 2 + 19s+ 30 
s + 1 


= -4 


= -11 


s=-2 

-t _ A+„-2t _ iu-2 1\ 


Upon inverse transformation, y{t) = (14e 4 — 4 te 2t — lie ~ t )u(t). 
As a check, we confirm that y(0) = 3 and y'( 0) = —14 + 22 — 4 = 4. 


(b) (Zero-State Response) For the zero-state response, we assume zero initial conditions to obtain 

(s 2 + 3s + 2)Yzs(s) = —— 
s + 2 

This gives 

4 4 4 4 

zs(s) ~~ (s + 2)(s 2 + 3s + 2) ~ ^Tl “ (s + 2) 2 “ s~+2 

Inverse transformation gives y zs (t) = (4e _t — 4 te~ 2t — 4 e~ 2t )u(t). 


(c) (Zero-Input Response) For the zero-input response, we assume zero input to obtain 

(s 2 + 3s + 2)y zi (s) = 3s + 13 Uzi(s) = 2 ' „ ~ = ——. —x 

s z + 3s + 2 s + 1 s + 2 

Upon inverse transformation, j/ zi (f) = (10e _t — 7 e~ 2t )u(t). The total response equals 
y(t) = Vzs(t) + 2/zi (t) = (14e _t - 4 te~ 2t - lle _2t )u(t) 

This matches the result found from the direct solution. 
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A.4.5 The Steady-State Response to Harmonic Inputs 

The steady-state response of an LTI system to a sinusoid or harmonic input is also a harmonic at the input 
frequency. To find the steady-state response y ss (t ) to the sinusoidal input x(t) = Acos(co 0 t + 9 ), we first 
evaluate the transfer function at the input frequency wp to obtain H(u> o) = K/_cf). The output is then given 
by y ss (t) = KAcos(u 0 t + 9 + </>). 


EXAMPLE A.7 (Steady-State Response to Harmonic Inputs) 

s — 2 

Let His ) = ----. Find the steady-state response y ss (t) if xit) = 8cos(2 1) + 4. 

+ 4s + 4 


Let xUt) = 8cos(2 1). Then, u = 2, and Hi 2) = ---= 0.3536Z45 0 . 

w v ; w -4 + j8 + 4 

So, its steady state output is y\(t) = 8(0.3536)cos(2f + 45°) = 2.8284cos(2t + 45°) 

Let x 2 (t) = 4. Then, u> = 0 and H{ 0) = —0.5. So, its steady state output is y 2 (t) = (4)(—0.5) = —2. 
By superposition y ss (t .) = yi(t) + y 2 (t) = 2.8284cos(2f + 60°) — 2. 


A.5 Fourier Series 

The Fourier series is the best least squares fit to a periodic signal x p {t). It describes x p (t) as a sum of 
sinusoids at its fundamental frequency fo = 1/T and multiples fc/o whose weights (magnitude and phase) 
are selected to minimize the mean square error. The trigonometric, polar and exponential forms of the 
Fourier series are listed in the following review panel. 



REVIEW PANEL A.6 


Three Forms of the Fourier Series for a Periodic Signal x p 

l) 

Trigonometric 

no 

Polar 

no 

Exponential 

no 

qp + Ofc cos(27rfc/pt) + bh sm(2nkfot) c 0 + ^ cos(2irkf 0 t + 9 k ) ^ X[k]e’ 2nk ^° t 

k =1 

k= 1 

k=— oo 


REVIEW PANEL A.7 

The Exponential Fourier Series Coefficients Display Conjugate Symmetry 

X[0 \ = l- f x{t)dt X[k\ = ^ f x(t)e- j2 ” kfot dt X[-k} = X*[k] 

r JT 1 JT 


The connection between the three forms of the coefficients is given by 

X[0] = ao — Co and X[fc] = 0.5(afc — jbk) = 0.5Cfc/0fc, k > 1 (A-14) 

The magnitude spectrum and phase spectrum describe plots of the magnitude and phase of each 
harmonic. They are plotted as discrete signals and sometimes called line spectra. For real periodic signals, 
the V[fc] display conjugate symmetry. 
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EXAMPLE A.8 (Some Fourier Series Results) 


(a) (A Pure Sinusoid) If x(t) = cos(27r f 0 t), its exponential Fourier series coefficients are X[l] = 
0.5, X[— 1] = 0.5. Its two-sided magnitude spectrum shows sample values of 0.5 at / = ±/o- 

If x(t ) = cos( 27 t f 0 t + 9), its exponential coefficients are X[l] = 0.5e j61 , X[— 1] = 0.5e~l e . So, Its 
two-sided magnitude spectrum has sample values of 0.5 at / = ±/o and its phase spectrum shows a 
phase of 8 at /o and —9 at —fo- 

(b) (An Impulse Train) From Figure EA.8B, and by the sifting property of impulses, we get 

1 r T / 2 i 

X[k} = r 5{t)e~^^dt=- 
1 J-T/2 1 

All the coefficients of an impulse train are constant! 



T 

Figure EA.8B Impulse train and its Fourier series coefficients for Example A.8(b) 

(c) (A Rectangular Pulse Train) The coefficients X[k\ of a train of the rectangular pulse train shown 
in Figure EA.8C are 

X[k\ = ^sinc(fc/ 0 t 0 ) 



-tfj/2 tj 2 T -tj 2 r 0 /2 

Figure EA.8C Rectangular pulse train and its one period for Example A.8(c) 

A.5.1 Some Useful Results 

A time shift changes x p (t) to y p (t ) = x p (t ± a) changes the Fourier series coefficients from X[k] to Y[k] = 
X[k\e-i 2nk f° a . So, the magnitude spectrum shows no change. 

Zero Interpolation of the Spectrum 

A zero interpolation of the spectral coefficients X[/c] to X[k/N] leads to an iV-fold signal compression (with 
N compressed copies) within one time-period. Figure A.4 illustrates this result for compression by 2. 

The signal power may be found in the time domain from x p (t) or in the frequency domain from \X[k] 
(its magnitude spectrum). This is Parseval’s theorem for periodic signals. 
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Periodic signal Fourier series spectrum 




Compression by 2 Zero interpolation by 2 




Figure A.4 Signal compression leads to zero interpolation of the spectrum 


1 r °° 

p = t x pW dt= \ x m 2 

T k=— oo 


(A.15) 


The Gibbs Effect 

The Gibbs effect states that perfect reconstruction from harmonics is impossible for signals with jumps. 
The reconstructed signal shows overshoot and undershoot (about 9% of jump) near each jump location the 
reconstructed value equals the midpoint value of the jump at each jump location. 


A.6 The Fourier Transform 

The Fourier transform provides a frequency-domain representation of a signal x{t) and is defined by 

/ oo /»oo 

a:(f)e“' j27r '^ dt (the/-form) X(u) = / x(t)e~^ wt dt (the tn-form) 

-oo J — OO 

The inverse Fourier transform allows us to obtain x(t) from its spectrum and is defined by 

/ oo -i r oo 

X(f)e :i27T f t df (the/-form) x(t) = — / A(w)e- Ja;t dui (the w-form) 

-oo J—oo 

The Fourier transform is, in general, complex. For real signals, X(f) is conjugate symmetric with X(—f) = 
X*(f). This means that the magnitude |AT(/)| or Re{A(/)} displays even symmetry and the phase /(/) or 
Im{X(/)} displays odd symmetry. It is customary to plot the magnitude and phase of X(f) as two-sided 
functions. The effect of signal symmetry on the Fourier transform are summarized. 


REVIEW PANEL A.8 

Effect of Signal Symmetry on the Fourier Transform of Real-Valued Signals 
Even symmetry in x(t): The Fourier transform X(f) is real and even symmetric. 

Odd symmetry in x(t): The Fourier transform X(f ') is imaginary and odd symmetric. 
No symmetry in x(t): Re{X(/)} is even symmetric, and Im{A(/)} is odd symmetric. 
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The three most useful transform pairs are listed in the following review panel. 


REVIEW PANEL A.9 
Three Basic Fourier Transform Pairs 


5 (t) 

n (1) <=> , 

t 




Table A.6 lists the Fourier transform of various signals while Table A.7 lists various properties and theorems 
useful in problem solving. 


A.6.1 Connections between Laplace and Fourier Transforms 

The following review panel shows the connection between the Fourier and Laplace transform. We can always 
find the Laplace transform of causal signals from their Fourier transform, but not the other way around. 

| REVIEW PANEL A. 10 | 

Relating the Laplace Transform and the Fourier Transform 

From X(s) to X(f): If x(t) is causal and absolutely integrable, simply replace s by j2nf. 

From X(f) to X(s): If x(t) is causal , delete impulsive terms in X(f) and replace j2nf by s. 


Some Useful Properties 

Scaling of x(t) to x{at) leads to a stretching of X(f) by a and an amplitude reduction by |a|. If a signal 
x(t) is modulated (multiplied) by the high-frequency sinusoid cos(27r/ 0 f), its spectrum X(f) gets halved and 
centered at / = ±/o- This modulation property shifts the spectrum of x(t) to higher frequencies. 

x(t)cos(2nf 0 t) 4=[ft]=» 0.5[X(/ + f 0 ) + X(f - / 0 )] (A.16) 

Parseval’s Theorem says that the Fourier transform is an energy-conserving relation, and the energy may 
be found from the time signal x(t) or its magnitude spectrum |A(/)|. 

/ OO cOO 

x\t)dt= / \X(f)\ 2 df (A.17) 

-oo J — OO 


EXAMPLE A.9 (Some Transform Pairs Using Properties) 

(a) For x{t) = tri(f) = rect(f) *rect(f), use rect(t) <= \ ft | => sinc(/) and convolution (see Figure EA.9A): 


tri(f) 


rect(t) *rect(t) 


FT 


sine (/) sine (/) 


sinc 2 (/) 


rectfd 

1 

rect(d 

1 

tried 


❖ 

t 



,= / 

\, 


-0.5 0.5 -0.5 0.5 -1 1 



Figure EA.9A The signals for Example A.9(a and b) 



t 
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Table A.6 Some Useful Fourier Transform Pairs 


Entry 

x{t) 

x(f) 

XU) 

1 

m 

l 

i 

2 

rect(t) 

sine (/) 

• ( u \ 
sme — 

\2ir J 

3 

tri(i) 

sine 2 (/) 

■ u u \ 

sme — 

\2irJ 

4 

sinc(t) 

rect(/) 

rec ‘0 

5 

cos(27raf) 

0-5 [8(,f + a) + S(f — a)] 

n[5(ui + 27TQ;) + 8{w — 2 tto)\ 

6 

sin(27rat) 

j0.5[8(f + a) - 8(f - a)] 

J7t[(5(co’ + 27ra) — 8(u> — 27ra)] 

7 

e~ at u(t) 

1 

a + j2nf 

1 

a + ju> 

8 

te~ at u{t) 

1 

(a + j2nf) 2 

1 

(a + ju) 2 

9 

e -a|t| 

2a 

a 2 + 4-7T 2 / 2 

2a 

a 2 + u) 2 

10 

e-^ 2 

e -f 2 

g-uP/4 7T 

11 

sgn(t) 

1 

jnf 

2 

ju 

12 

u(t) 

aM(/) + ^/ 

TrS(u) H- 

13 

e~ at cos(2ir 

a + j2nf 

a + juj 

(a + j2nf) 2 + (2ir[3) 2 

(a + juj) 2 + (27r/3) 2 

14 

e~ at sin(27 i(3t)u{t) 

2tt/3 

2tt/3 

(a + j2nf) 2 + (2nf3) 2 

(a + juj) 2 + (27T/3) 2 

15 

OO 

E W-nT) 

n=— oo 

f £<'-?) 

k=— oo ' ' 

r A V“~J 

k——oo ' ' 

16 

OO 

x p (t)= E X[k]e j2 ” kfot 

k=— oo 

oo 

E X[k]S(f-kfo) 

k— —oo 

oo 

E 27rX[fc]^(a; — fcwo) 

k— —oo 
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Table A.7 Operational Properties of the Fourier Transform 


Property 

x(t) 

X{f) 

X(cu) 

Similarity 

x(t) 

x{-f) 

2irx(—aj) 

Time Scaling 

x{at ) 

1 a/^ 

|a| W 

r*G 

Folding 

x{-t) 

x(-f) 

A(-G 

Time Shift 

x{t — a) 

e -j^f a X{f) 

e- J “ Q A(w) 

Frequency Shift 

e j2irat x ^ 

x(f - a) 

A(w — 27TQ;) 

Convolution 

x(t) * h(t) 

X(f)H(f) 


Multiplication 

x(t)h{t) 

X(f)*H{f) 

—A(w) -kH(u>) 

Modulation 

x{t)cos{2nat) 

0.5[A(/ + a) + A(/-a)] 

0.5 [ A (w + 27ra) + A(w — 27ra)] 

Times-t 

—j2irtx(t) 

x'U) 

27rA'(w) 

Conjugation 

x*(t) 

x*(-f) 

a*(-G 

Correlation 

x(t) **y{t) 

X(f)Y*{f) 

X{w)Y*{w) 

Autocorrelation 

x{t) **x(t) 

X(f)X*(f) = A(/) 2 

A(w)A*(u) = A(w) 2 

Fourier Transform Theorems 

Central 

ordinates 

pOO -i p OO p oo 

x(0) = / X(f)df=— / X(cu)doj A(0) = 1 x{t)dt 

J — oo ^J — oo J —oo 

Parse val’s 

theorem 

E= J°° x\t)dt = f |A(/)| 2 d/ = i- j 

'OO 

A(w) 2 dw 

-OO 

Plancherel’s 

theorem 

pOO pOO -i pOO 

/ x(t)y*(t)dt = / X(f)Y*(f)df=- AM y»du; 

J —oo J —oo J —oo 
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(d) For x(t) = sgn(f), use the limiting form for y(t) = e at u(t) — e at u(—t) as a —> 0 to give 
g— at u u\ j.\ , rv^ri , ^ 1 — 4J7r/ _ /j.\ , rr^n 


(<) - e at u(-t) <= | ft | = 


a + j’27t/ a — j27r/ a 2 + 47r 2 / 2 


sgn(t) -4= | ft - 


(e) For x(t) = cos(27rcrf) = 0.5e- j2,rQt + 0.5e ■ ?27r “ t , start with 1 4= ft => i5(/) and use the dual of the 
time-shift property: 

cos(2wat) = Q.be^ 27rat + 0.5e _j27rat 4= ft => 0.5 S(f — a) + 0.5i5(/ + a) 

Its magnitude spectrum (see Figure EA.9H(a)) is an impulse pair at / = ±a, with strengths of 0.5. 


(f) For x(t) = cos(2nat + 9), start with cos(27ro4) <= ft => 0.5<5(/ — a) + 0.5<5(/ + a), and use the shifting 
property with t — > t + 9/2T:a (and the product property of impulses) to get 

cos(27ra4 + 9) <= | ft | => 0.5 eP e ^ a [S(f — a) + S(f + a)] = 0.5 e^ e 5{f — a) + 0.5 e~^ e 5{f — a) 

Its magnitude spectrum is an impulse pair at / = ±a with strengths of 0.5. Its phase spectrum shows 
a phase of 9 at / = a and —9 at f = — a . The spectra are shown in Figure EA.9H(b). 


(a) Transform of cos(2jta t) (b) Transform of cos(27ta/+0) 



Figure EA.9F The Fourier transforms of cos( 27 t at) and cos(27rat + 6) 


A.6.2 Amplitude Modulation 

Communication of information often requires transmission of signals, or messages, through space by convert¬ 
ing electrical signals to electromagnetic waves using antennas. Efficient radiation requires antenna dimensions 
comparable to the wavelength of the signal. The wavelength A of a radiated signal equals c/f, where c is 
the speed of light (at which electromagnetic waves travel) and f is the signal frequency. Transmission of 
low-frequency messages, such as speech and music, would require huge antenna sizes measured in kilometers. 
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A practical approach is to shift low-frequency messages to a much higher frequency using modulation and 
to transmit the modulated signal instead. In turn, this requires a means of recovering the original message 
at the receiving end, a process called demodulation. Amplitude modulation schemes typically modulate 
the amplitude of a high-frequency carrier Xc(t) = cos( 27 t fct) by a message signal Xs(t) band-limited to a 
frequency B <C fc- In DSBSC (double-sideband suppressed-carrier) AM, the carrier xc{t ) is multiplied by 
the message xs{t). The modulated signal Xu{t) and its spectrum Xm{S) are given by 

x M {t) = xs(t)x c (t) = x s (t)cos(2Trf c t) X M (f) = 0.5 [X(f + f c ) + X(f - f c )] (A.18) 

The message spectrum is centered about ±fc as illustrated in Figure A.5. It exhibits symmetry about ±/c- 
The portion for / > fc is called the upper sideband (USB) and that for / < fc |, the lower sideband 
(LSB). Since Xs(t) is band-limited to B , the spectrum occupies a band of 2 B (centered about ±/c)- 


Message spectrum 



Figure A. 5 DSBSC amplitude modulation 


Detection 

At the receiver, the message xs(t) may be recovered using demodulation or detection. In synchronous 
or coherent detection, the AM signal is multiplied by cos(27r fct) and then lowpass filtered, as shown in 
Figure A.6. 


DSBSC AM spectrum 


A 1 A 


Multiplier 


-fn 


l 

Spectrum of demodulated signal 


Carrier spectrum 

n (0.5) 

(0.5)* 


/ 

~fc 

fc 1 




-2 L 


A 



Lowpass 


/ 

filter 



Message spectrum 
0.5 X(f) 


A 


f 


-B B 2/ c -B B 

Figure A.6 Synchronous demodulation of DSBSC AM 

With x m( t) = xs(t)cos(2Trfct), the demodulated signal equals 

x D (t) = x M (t) cos (2n f c t) = xs{t)cos(2TTf c t)cos(2TTf c t) 


(A.19) 
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Using the identity cos 2 (a) = 0.5(1 + cos 2a), we obtain 

xn{t) = 0.5 xs(t) + 0.5xs{t)cos(4:nfct) (A.20) 

If xn(t) is passed through a lowpass filter with a gain of 2 and a bandwidth of B, the high-frequency 
component (centered at ±2/ c ) is blocked and we recover the message Xs(t). 

This method is called synchronous or coherent because it requires a signal whose frequency and phase (but 
not amplitude) matches the carrier. For DSBSC AM, this coherent signal may be obtained by transmitting 
a small fraction of the carrier (a pilot signal ) along with XM{t). 


A.6.3 Fourier Transform of Periodic Signals 

The Fourier transform of a periodic signal is an impulse train described by 

oo oo 


x P {t)= Y X[k]e j2 ” kfot 

k ——oo 


FT 


Y X[k]6(f-kfo) 


(A.21) 


The impulses are located at the harmonic frequencies kfo, and the impulse strengths are given by the Fourier 
series coefficients X[k]. The impulse train is periodic only if X[k] = C (i.e. has the same value for every k). 


EXAMPLE A.10 (Fourier Transform of an Impulse Train) 

For a unit impulse train with period T, as shown in Figure EA.10, we get 




l 


Jid) 1 

id) 1 

id) 1 

1(1) 1 

id) 1 

id) ^ 

X[k] = i (all k) 

t 



T 

Figure EA.10 Impulse train and its Fourier series coefficients for Example A. 10 
The Fourier transform of this function is 

OO -J OO -J 

X{f)= Y X\mf-kf 0 ) = - Y S(f-kfo), fo = J, 

k =—oo k =—oo 

The Fourier transform of a periodic impulse train is also a periodic impulse train. For other periodic signals, 
the Fourier transform will is not periodic (even though it is an impulse train). 


A.6.4 Spectral Density 

The spectral density is the Fourier transform of the autocorrelation function. 

(autocorrelation) r xx (t) 4= | ft | =» R X x{f) (spectral density) (A.22) 

This is the celebrated Wiener-Khintchine theorem. For power signals (and periodic signals), we must 
use averaged measures consistent with power (and not energy). This leads to the concept of power spectral 
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density (PSD). The PSD of a periodic signal is a train of impulses at / = kfo with strengths |X[fc]| 2 whose 
sum equals the total signal power. 

OO 

Rxx{f)= E \X[k\\ 2 8{f-kf 0 ) (A.23) 

k——oo 


White Noise and Colored Noise 

A signal with zero mean whose PSD is constant (with frequency) is called white noise. The autocorrelation 
function of such a signal is an impulse. A signal whose PSD is constant only over a finite frequency range is 
called band-limited white noise. 

A.6.5 Ideal Filters 

The transfer function F?lp(/) and impulse response /iLp(t) of an ideal lowpass filter (LPF) with unit gain, 
zero phase, and cutoff frequency fc may be written as 

Hhp(f) = rect(//2/ c ) h LP (t) = 2/ c sinc(2/ c t) (ideal LPF) (A.24) 

Ideal filters are impractical for the reasons summarized in the following review panel. Even though ideal 
filters are unrealizable, they form the yardstick by which the design of practical filters is measured. 

| REVIEW PANEL A. 11 | 

Ideal Filters Are Noncausal, Unstable, and Physically Unrealizable 

1. Ideal filters possess constant gain and linear phase in the passband. 

2. Their impulse response (with a sine form) makes them noncausal and unstable. 

3. The step response of ideal filters cannot be monotonic and shows overshoot and ringing. 


A.6.6 Measures for Real Filters 


The phase delay and group delay of a system whose transfer function is H(lo) = \H(u>)\f9(uj) are defined 
as 


tp 


(phase delay) 


t 9 = 


(group delay) 


(A.25) 


u> ' ' " dco 

If 9{uS) varies linearly with frequency, t p and t g are not only constant but also equal. For LTI systems (with 
rational transfer functions), the phase 9(co) is a transcendental function but the group delay is always a 
rational function of u> 2 and is much easier to work with in many filter applications. 

The time-limited/band-limited theorem asserts that no signal can be both time-limited and band- 
limited simultaneously. In other words, the spectrum of a finite-duration signal is always of infinite extent. 
The narrower a time signal, the more spread out its spectrum. Measures of duration in the time domain 
are inversely related to measures of bandwidth in the frequency domain and their product is a constant. A 
sharper frequency response \H(lu)\ can be achieved only at the expense of a slower time response. Typical 
time-domain and frequency domain measures are listed in Table A.8. 


A.6.7 A First Order Lowpass Filter 


Consider the RC circuit shown in Figure A.7. If we assume that the output is the capacitor voltage, its 
transfer function may be written as 


H(f) _ Y(f ) _ 1/J2 nfC = 1 = 1 

U) X(f) R + (l/j2nfC) 1 + j2nfRC 1 + j2tt/t 


(A.26) 
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Table A.8 Typical Measures for Real Filters 


Measure 

Explanation 

Time delay 

Time between application of input and appearance of response 
Typical measure: Time to reach 50% of final value 

Rise time 

Measure of the steepness of initial slope of response 

Typical measure: Time to rise from 10% to 90% of final value 

Overshoot 

Deviation (if any) beyond the final value 

Typical measure: Peak overshoot 

Settling time 

Time for oscillations to settle to within a specified value 

Typical measure: Time to settle to within 5% or 2% of final value 

Speed of Response 

Depends on the largest time constant r max in h(t). 

Typical measure: Steady state is reached in about 5r max . 

Damping 

Rate of change toward final value 

Typical measure: Damping factor £ or quality factor Q 

Bandwidth 

Frequency range over which gain exceeds a given value. 

Typical measure: S 3d B for which \H(f)\ > 0.707 \H(f)\ max . 






H{ 03) = 


1 

1 + jatRC 


Figure A.7 An RC lowpass filter 


The quantity r = RC is the circuit time constant. The magnitude \H(f)\ and phase 9(f) of the transfer 
function are sketched in Figure A.8 and given by 


\ h U)\ = —f= 1 9(f) = “tan 1 (2 tt/t) 

y/1 + 47r 2 / 2 r 2 


(A.27) 



Figure A. 8 Frequency response of the RC lowpass filter 


The system is called a lowpass filter because \H(f)\ decays monotonically with positive /, leading to a 
reduced output amplitude at higher frequencies. At / = the magnitude equals l/y/2 (or 0.707) and the 
phase equals —45°. The frequency / = is called the half-power frequency because the output power 
of a sinusoid at this frequency is only half the input power. The frequency range 0 < / < yyy defines the 
half-power bandwidth over which the gain exceeds 0.707 times the peak gain. 
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The time-domain performance of this system is measured by its impulse response h(t) = e t / T u(t), or by 
its step response s(t), plotted in Figure A.9, and described by 

h(t) = e~ t ^ T u(t) s(t) = (1 — e -t /' r )u(t) (A.28) 

The step response rises smoothly to unity and is within 1% of the final value in about 5r. A smaller r max 
implies a faster response, a shorter time to reach steady state. Other performance measures include the rise 
time t r (the time taken to rise from 10% to 90% of the final value).The 10%-90% rise time T r is computed 
by finding 

s(iio) = 1 - e~ tlo/T = 0.1 s(t 90 ) = 1 - e~ t9o/T = 0.9 

We obtain tio = rln(10/9), tgo = rln 10, and T r = tg 0 — fio = rln9. 

With !? 3 dB = the time-bandwidth product gives 

T r B 3dB = Tln9 « 0.35 

27TT 

This result is often used as an approximation for higher-order systems also. 



Figure A. 9 Impulse response h(t) and step response s(t) of the RC lowpass filter 


The delay time t,i (the time taken to rise to 50% of the final value), and the settling time tp% (the time 
taken to settle to within P% of its final value). Commonly used measures are the 5% settling time and the 
2% settling time. Exact expressions for these measures are found to be 

td = rln2 t 5 % = rln20 <2% = T l n 50 (A.29) 

A smaller time constant r implies a faster rise time and a larger bandwidth. The phase delay and group 
delay of the RC lowpass filter are given by 

1 d0(f) 


*' = -|§ = 2 ^ 7 tan " ,(2 ’ r/r) 


tg 2?r 


df 


1 + 47T 2 / 2 T 2 


(A.30) 


REVIEW PANEL A. 12 


Frequency Response of an RC Lowpass Filter with Time Constant r = RC 

/ 3 dB = - Hz 10%-90% Rise-Time: rln 9. Time-Bandwidth Product: « 0.35 

27TT 


A.6.8 A Second-Order Lowpass Filter 

A second-order lowpass filter with unit dc gain may be described by 

H(s) = ■ 


Q s 


- uz 


(A.31) 


Here, lu p is called the undamped natural frequency, or pole frequency, and Q represents the quality 
factor and is a measure of the losses in the circuit. The quantity £ = 1/2Q is called the damping factor. 
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Frequency Domain Performance 

If Q > 0.5, the poles are complex conjugates, and lie on a circle of radius uj p in the s-plane. The higher 
the Q, the closer the poles are to the jcu- axis. For Q < l/\/2, the magnitude \H(u>) \ is monotonic, but for 
Q > l/\/2 it shows overshoot and a peak near to p , and the peaking increases with Q as shown in Figure A.10. 
The phase delay and group delay of second-order filters are given by 


0(u>) = — tan 1 


( u/u P )/Q 

1 - (io/iO p ) 2 _ 


2(u p /Q)(u> p + uj' 2 ) 

(oj 2 - w 2 ) 2 + (w 2 /Q 2 )w 2 


(A.32) 



“ P k 

Figure A.10 Frequency response of a second-order system 


Time-Domain Performance 

The step response of second-order lowpass filters also depends on Q , as shown in Figure A. 11. If Q < 0.5, 
the poles are real and distinct, and the step response shows a smooth, monotonic rise to the final value 
(overdamped) with a large time constant. If Q > 0.5, the poles are complex conjugates, and the step 
response is under damped with overshoot and decaying oscillations (ringing) about the final value. This 
results in a small rise time but a large settling time. The frequency of oscillations increases with Q. For 
Q = 0.5, the poles are real and equal, and the response is critically damped and yields the fastest 
monotonic approach to the steady-state value with no overshoot. 



Figure A. 11 Step response of a second-order system 


EXAMPLE A.11 (Results for Some Analog Filters) 

The step response and impulse response of the filters shown in the following figure are summarized below. 
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Figure EA.ll. Filters for Example A.11. 


(a) (A Second-Order Bessel Filter) 

3 

His) = ---- Differential equation: y"it) + 3 y'it) + 3 yit) = 3x(t). 

T 3s T 3 

Step response: s{t ) = u{t) — e -3t / 2 [cos(\/3V2) + v / 3sin(v / 3t/2)]w(t). 
Impulse response: h{t) = 2v / 3e -34 / 2 sin(v / 3t/2)u(t). 


(b) (A Second-Order Butterworth Filter) 

H(s ) = -- Differential equation: y"(t) + \/2y'(t) + y(t ) = x(t). 

s 2 + V2s + 1 

Step response: s(t) = u(t) — e _t / v/2 [cos(f/v / 2) + sin(t/\/2)]u(t). 

Impulse response: h{t) = t/(f) = v / 2e _ */ v/2 sin(f/v / 2)it(t). 


(c) (A Third-Order Butterworth Filter) 

H{s) = g3 2s 2 2s + 1 Differential equation: y"'{t) + 2 y"(t) + 2 y'(t) + y(t) = \x{t). 
Step response: s(t) = \u(t) — ^e - */ 2 sin(v / 3t/2)w(t) — |e _t M(t). 

Impulse response: h{t) = sin(\/3t/2) — \ cos(v / 3t/2)]u(t) — ie _t M(t). 


A.7 Bode Plots 

Bode plots allow us to plot the frequency response over a wide frequency and amplitude range by using 
logarithmic scale compression. The magnitude or gain is plotted in decibels (with H^b = 20log \H(f)\) 
against log(/). For LTI systems whose transfer function is a ratio of polynomials in ju>, a rough sketch 
can be quickly generated using linear approximations called asymptotes over different frequency ranges to 
obtain asymptotic Bode plots. The numerator and denominator is factored into linear and quadratic 
factors in ju> with real coefficients. A standard form is obtained by setting the real part of each factored 
term to unity A summary appears in the following review panel. 


REVIEW PANEL A. 13 

Some Asymptotic Plots. Note: 20 dB/dec = 6 dB/oct 

Term = ju>: Straight line with slope = 20 dB/dec for all to with H^b = 0 at u) = 1 rad/s. 
Term = 1 + j — : For to < a, H^b = 0. For to > a, straight line with slope = 20 dB/dec. 
If repeated k times: Multiply slopes by k. If in denominator: Slopes are negative 
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The frequency a where the slope changes is called break frequency. For a first order filter, the break 
frequency is also called the 3-dB frequency (or the half-power frequency) because the true value differs from 
the asymptotic value by 3 dB at this frequency. 


For H( co) = j co 


For H( co) = — 
jw 


For H( co) = l+7'(co/a) 


For H{i o) = 


1 

1+y(co/a) 



Figure A. 12 shows asymptotic magnitude plots of various first order terms. The decibel value of a constant 
H(u>) = K is IFdB = 20 log \K\ dB, a constant for all to. The Bode magnitude plot for a transfer function 
with several terms is the sum of similar plots for each of its individual terms. The composite plot can be 
sketched directly using the guidelines of the following review panel. 


| REVIEW PANEL A.14 | 

Guidelines for Sketching a Composite Asymptotic Magnitude Plot for H(u>) 

Initial slope: 20 dB/dec (with H^b = 0 at w = 1 rad/s) if a term jui is present; 0 dB/dec if absent. 

At a break frequency: The slope increases by 20 k dB/dec due to a (repeated by k) numerator term 
and decreases by 20fc dB/dec due to a denominator term. 


EXAMPLE A.12 (Bode Magnitude Plots) 

....... ^ . T rr . , 40(0.25 + jw)(10 + ju) 

(a) (Linear Factors) Let H(u>) = -—--—--. 

ju(20 + juj) 

We write this in the standard form 


H M 


5(1+ jw/0.25)(l + jw/10) 
jw(l+ jw/ 20 ) 


The break frequencies, in ascending order, are: 

u>i = 0.25 rad/s (numerator) U 2 = 10 rad/s (numerator) U 3 = 20 rad/s (denominator) 

The term 1 /ju provides a starting asymptote —20 dB/dec whose value is 0 dB at u> = 1 rad/s. We 
can now sketch a composite plot by including the other terms: 

At lu 1 = 0.25 rad/s (numerator), the slope increases by (by +20 dB/dec) to 0 dB/dec. At a >2 = 10 
rad/s (numerator), the slope increases to 20 dB/dec. Finally, at W 3 = 20 rad/s (denominator), the 
slope decreases to 0 dB/dec. 

Finally, the constant 5 shifts the plot by 20log 5 = 14 dB. Its Bode plot is shown in Figure EA.12(a). 
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(a) Asymptotic (dark) and exact magnitude 



10~ 2 10 1 10 ° 10 1 10 2 10 3 
Frequency co [rad/s] 


(b) Asymptotic (dark) and exact magnitude 



-10 1 2 3 4 

10 10 10 10 10 10 


Frequency (O [rad/s] 


Figure EA.12 Bode magnitude plots for Example A.12(a and b) 


(b) (Repeated Factors) Let H(») = (1 ( ^t,/“o)‘(t 0) ' 

Its Bode plot is sketched in Figure EA.12(b). We make the following remarks: 
The starting slope is 0 dB/dec since a term of the form ( ju) k is absent. 

The slope changes by —40 dB/dec at u>b = 10 rad/s due to the repeated factor. 


A.8 Classical Analog Filter Design 

Classical analog filters include Butterworth (maximally flat passband), Chebyshev I (rippled passband), 
Chebyshev II (rippled stopband) and elliptic (rippled passband and stopband) as shown in Figure A.13. The 
design of these classical analog filters typically relies on frequency specifications (passband and stopband 
edge(s)) and magnitude specifications (maximum passband attenuation and minimum stopband attenua¬ 
tion) to generate a minimum-phase filter transfer function with the smallest order that meets or exceeds 
specifications. 

Most design strategies are based on converting the given frequency specifications to those applicable to 
a lowpass prototype with unit radian cutoff frequency, designing the lowpass prototype and converting to 
the required filter type using frequency transformations. We only concentrate on the design of the lowpass 
prototype. Table A.9 describes how to obtain the prototype specifications from given filter specifications, the 
design recipe for Butterworth and Chebyshev filters, and frequency transformations to convert the lowpass 
prototype back to the required form. 

For bandpass and bandstop filters, if the given specifications [/i, / 2 , / 3 , /q] are not geometrically 
symmetric, one of the stopband edges must be relocated (increased or decreased) in a way that the new 
transition widths do not exceed the original. The quadratic transformations to bandpass and bandstop 
filters yield transfer functions with twice the order of the lowpass prototype. 

The poles of a Butterworth lowpass prototype lie equispaced on a circle of radius R = (l/e) 1 /™ in the 
s-plane while the poles of a Chebyshev prototype lie on an ellipse. The high-frequency attenuation of an 
nth-order Butterworth or Chebyshev lowpass filter is 20?i dB/dec. 
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Table A.9 Analog Filter Design 


NOTES- For IP filters u — Sto P band ed s e p or HP filters v — Passband ed s e 

ror nr mrers, v s — Passband edge ror nr Hirers, h s - Stopband edge 

For BP and BS filters, with band edges [/i, f 2 , / 3 , fi] in increasing order: u s = 

If /o is the center frequency, we require geometric symmetry with /1/4 = 72/3 = /q. 


Butterworth 

Chebyshev 

Ripple 

e 2 = io 01A p - 1 

e 2 = 10 olAp - 1 

Order 

log[(10 01As — l)/e 2 ] 1/2 

cosh -i [(10 01As — l)/e 2 ] 1 / 2 

log(p s ) 

Tl — 1 

cosh (v s ) 

3-dB Frequency 

p 3 = (1/e) 1/n = R 

1 S 3 = cosh — cosh -1 (1 /e) 
n 

Poles of H(s) 

Pk = —R sin 8 k + jR cos 9k 

9k = (2 k — l)7r/2n 

k = 1,2 ,...,n 

Pk = — sin 9k sinh(a) + j cos 9k cosh (a) 

9k = { 2 k — l)n/ 2 n a = 4 sinh -1 (4) 

k = 1, 2,..., n 

Denominator Qp{s) 

(s ~Pi)(s -P 2 ) ...{s- p n ) 

{s - Pi){s - P 2 ) ■ ■ ■ {s - p n ) 

K for unit peak gain 

n 

K = Qp(0) = Y\ P k 

k =1 

j Qp{ 0)/Vl + e 2 n even 
} Qp(0) n odd 

For transformation of the LPP transfer function H{s ) to other forms, use: 

To LPF s => s/iOp To HPF s =>• ujs To BPF s => To BSF s => 

PI SB bp S^+Ug 

where ojq = 2i r/ 0 and £?bp = 27 r(/ 3 — f 2 ) for bandpass, 1?bs = 27t(/4 — /)) for bandstop 

NOTE: For numerical computation, cosh -1 (a;) = ln[a; + (x 2 — l) 1 / 2 ], x > 1 


EXAMPLE A.13 (Analog Filter Design) 

(a) (Butterworth Lowpass Filter) Design a Butterworth filter to meet the following specifications. 
A p <1 dB for / < 4 kHz A s > 20 dB for / > 8 kHz 
From the design equations, v s = f s /f P = 2 and 
e 2 = 10 olA ? - 1 = 0.2589 

rc _ log[(10 0 ^- - l)/e 2 ] 1/2 _ log[(10 2 ~ 1 )A 2 ] 1/2 _ 4 2gQ n = 5 

log(i/ s ) log(2) 

v 3 = (1/e) 1 /" = 1.1447 = R 

We have 6/ = {2k — 1)7 t/2 n = 0.1(2fc — l)7r k = 1,2,..., 5 

This gives 9k = 0.17T, 0.37T, 0.57 t, 0 .77 t, 0 .97 t rad 

The pole locations pk = —Rsm(6k) + jRcos(6k) are then 
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p k = -1.1447, -0.3537 ± jl.0887, -0.9261 ± j0.6728 
The denominator Q(s) may be written as: 

Q(s) = s 5 + 3.7042s 4 + 6.8607s 3 + 7.8533s 2 + 5.5558s + 1.9652 

The numerator is given by K = Q(0) = 1.9652 

The transfer function of the analog lowpass prototype is then 


H(s) 


K 


1.9652 

s 5 + 3.7042s 4 + 6.8607s 3 + 7.8533s 2 + 5.5558s + 1.9652 


(b) (Butterworth Bandstop Filter) Design a Butterworth bandstop filter with 2-dB passband edges 
of 30 Hz and 100 Hz, and 40-dB stopband edges of 50 Hz and 70 Hz. 


The band edges are [/i, / 2 , / 3 , f&] = [30, 50, 70, 100] Hz. Since /1/4 = 3000 and / 2 /a = 3500, 
the specifications are not geometrically symmetric. Assuming a fixed passband, we relocate the upper 
stopband edge fs to ensure geometric symmetry / 2 /3 = /i/ 4 - This gives /3 = (30)(100)/50 = 60 Hz. 


The lowpass prototype band edges are v p = 1 rad/s and v s 


h - fi 7 , / 

- -— = 7 rad/s. 

h ~ J 2 


We compute e 2 = 10 o l " 4p — 1 = 0.5849 and the lowpass prototype order as 


lo g [( 10 01 ^ -l )/ e 2 ]!/ 2 
log 


=> n = 3 


The pole radius is R = (l/e) 1 /” = 1.0935. The pole angles are 9k = [f, f, rad. 

Thus, pk = — RsinOk + jRcos9k = —1.0935, 0.5468 ± j0.9470, and the lowpass prototype becomes 

H , )= _ 1^076 _ 

P[S> s 3 + 2.1870s 2 + 2.3915s+ 1.3076 


With ujq = W 1 W 4 = 47t 2 (3000) and B = 27t(/4 — / 1 ) = 27t( 70) rad/s, the LP2BS transformation 
s —> sB/(s 2 + <jJq) gives 


s 6 + 3.55(10) s s 4 + 4.21(10) lo s 2 + 1.66(10 ) 15 

“ s 6 + 8.04(10) 2 s 5 + 6.79(10) 5 s 4 + 2.56(10) 8 s 3 + 8.04(10) lo s 2 + 1.13(10) 13 s + 1.66(10 ) 15 


The linear and decibel magnitude of this filter is sketched in Figure EA.13B. 
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(a) Butterworth bandstop filter meeting passband specs 



(b) dB magnitude of bandstop filter in (a) 



0 30 50 70 100 130 

Frequency co [rad/s] 


Figure EA.13B Butterworth bandstop filter of Example A. 13(b) 


(c) (Chebyshev Lowpass Filter) Design a Chebyshev filter to meet the following specifications. 
A p <1 dB for / < 4 kHz A s > 20 dB for / > 8 kHz 
From the design equations: 
e 2 = 10 o lAp - 1 = 0.2589 

n = cosh -1 [( 10 01 ' 4s - lj/e 2 ] 1 / 2 = cosh - 1 [( 10 2 - Q/e 2 ] 1 / 2 ^ 2 ?g3 n = 3 

cosh ~ 1 (f s /fp) cosh -1 ( 2 ) 

v 3 = cosh [4 cosh -1 (1/e)] = 1.0949 
To find the poles, we first compute: 
a= (1/n) sinh - 1 (l/e) = 0.4760 
9k = (2k — l) 7 r/ 2 n = (2k — 1)7 t/6 fc = 1,2,3 
The poles pk = — sinh(a) sin(# fc ) + j cosh(a) cos (&k) then yield: 
p k = -0.4942, -0.2471 ± j 0.966 
The denominator Q(s) equals: 

Q(s) = s 3 + 0.9883s 2 + 1.2384s + 0.4913 

Since n is odd, the numerator is K = Q(0) = 0.4913 for unity peak gain. 

The transfer function of the analog lowpass prototype is then 


H(s) 


K 

W) 


0.4913 

s 3 + 0.9883s 2 + 1.2384s + 0.4913 


(d) (Chebyshev Bandpass Filter) Let us design a Chebyshev bandpass filter for which we are given: 
Passband edges: [uji, ui 2 , lo 3 , UJ 4 } = [0.89, 1.019, 2.221, 6.155] rad/s 

Maximum passband attenuation: A p = 2 dB Minimum stopband attenuation: A s = 20 dB 

The frequencies are not geometrically symmetric. So, we assume fixed passband edges and compute 
u >q = UJ 2 UJ 3 = 1.5045. Since W 1 W 4 > Wg, we decrease W 4 to U 14 = Uq/ui = 2.54 rad/s. 


©Ashok Ambardar, September 1, 2003 





506 


Appendix A Useful Concepts from Analog Theory 


Then, B = oj 3 — u> 2 = 1.202 rad/s, v p = 1 rad/s, and v s = M4 B Ul = 2 ' 5 1 4 20 ° 2 89 = 1.37 38 rad/s. 
The value of e 2 and the order n is given by 


e 2 = io 01A p - 1 = 0.5849 


cosh 1 [(10 olj4s — l)/e 2 ] 1 / 2 


cosh 1 1 


= 3.879 => n = 4 


The half-power frequency is v 3 = cosh[l cosh 1 (1/e)] = 1.018. To find the LHP poles of the prototype 
filter, we need 


a = (l/n)sinh 1 (1/e) = 0.2708 9k{ rad) = ^— ——9^, A = 1,2, 3,4 

2 n 8 

From the LHP poles pk = — siiili a sin 0^ + j cosh a cos 9k, we compute pi, P 3 = —0.1049 ± j 0.958 and 
P 2 , P 4 = —0.2532 ± j0.3968. The denominator Qp(s) of the prototype Hp(s ) = K/Qp(s ) is thus 

Q P (s) = (s- px)(s - p 2 ){s - p 3 )(s - p 4 ) = s 4 + 0.7162s 3 + 1.2565s 2 + 0.5168s + 0.2058 

Since n is even, we choose K = Q P (0)/y/l + e 2 = 0.1634 for peak unit gain, and thus 

H , )= _0T634_ 

P[S> s 4 + 0.7162s 3 + 1.2565s 2 + 0.5168s + 0.2058 


We transform this using the LP2BP transformation s — » (s 2 +u>q)/sB to give the eighth-order analog 
bandpass filter H(s ) as 

H( ] = _0/Ms^_ 

s 8 + 0.86s 7 + 10.87s 6 + 6.75s 5 + 39.39s 4 + 15.27s 3 + 55.69s 2 + 9.99s + 26.25 

The linear and decibel magnitude of this filter is shown in Figure EA.13D. 


(a) Chebyshev BPF meeting passband specs 



0 0.89 2.22 4 6.16 8 

Frequency co [rad/s] 



_30 I _ mi 1 _ 1 _ I _ I _ I 

0 0.89 2.22 4 6.16 8 


Frequency co [rad/s] 


Figure EA.13D Chebyshev I bandpass filter for Example A.13(d) 
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